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Statistical Physics of Particles 


Statistical physics has its origins in attempts to describe the thermal properties 
of matter in terms of its constituent particles, and has played a fundamental 
role in the development of quantum mechanics. It describes how new behavior 
emerges from interactions of many degrees of freedom, and as such has found 
applications outside physics in engineering, social sciences, and, increasingly, 
in biological sciences. This textbook introduces the central concepts and tools 
of statistical physics. It includes a chapter on probability and related issues 
such as the central limit theorem and information theory, not usually covered 
in existing texts. The book also covers interacting particles, and includes an 
extensive description of the van der Waals equation and its derivation by 
mean-field approximation. A companion volume, Statistical Physics of Fields, 
discusses non-mean field aspects of scaling and critical phenomena, through 
the perspective of renormalization group. 


Based on lectures for a course in statistical mechanics taught by Professor 
Kardar at Massachusetts Institute of Technology (MIT), this textbook contains 
an integrated set of problems, with solutions to selected problems at the end 
of the book. It will be invaluable for graduate and advanced undergraduate 
courses in statistical physics. Additional solutions are available to lecturers on 
a password protected website at www.cambridge.org/9780521873420. 


MEHRAN KarbDak is Professor of Physics at MIT, where he has taught and 
researched in the field of statistical physics for the past 20 years. He received 
his B.A. at Cambridge, and gained his Ph.D. at MIT. Professor Kardar has 
held research and visiting positions as a junior Fellow at Harvard, a 
Guggenheim Fellow at Oxford, UCSB, and at Berkeley as a Miller 

Fellow. 


In this much-needed modern text, Kardar presents a remarkably clear view of statistical 
mechanics as a whole, revealing the relationships between different parts of this diverse subject. 
In two volumes, the classical beginnings of thermodynamics are connected smoothly to a 
thoroughly modern view of fluctuation effects, stochastic dynamics, and renormalization and 
scaling theory. Students will appreciate the precision and clarity in which difficult concepts are 
presented in generality and by example. I particularly like the wealth of interesting and 
instructive problems inspired by diverse phenomena throughout physics (and beyond!), which 
illustrate the power and broad applicability of statistical mechanics. 


Statistical Physics of Particles includes a concise introduction to the mathematics of probability 
for physicists, an essential prerequisite to a true understanding of statistical mechanics, but which 
is unfortunately missing from most statistical mechanics texts. The old subject of kinetic theory 
of gases is given an updated treatment which emphasizes the connections to hydrodynamics. 


As a graduate student at Harvard, I was one of many students making the trip to MIT from across 
the Boston area to attend Kardar’s advanced statistical mechanics class. Finally, in Statistical 
Physics of Fields Kardar makes his fantastic course available to the physics community as a 
whole! The book provides an intuitive yet rigorous introduction to field-theoretic and related 
methods in statistical physics. The treatment of renormalization group is the best and most 
physical I’ve seen, and is extended to cover the often-neglected (or not properly explained!) but 
beautiful problems involving topological defects in two dimensions. The diversity of lattice 
models and techniques are also well-illustrated and complement these continuum approaches. The 
final two chapters provide revealing demonstrations of the applicability of renormalization and 
fluctuation concepts beyond equilibrium, one of the frontier areas of statistical mechanics. 

Leon Balents, Department of Physics, University of California, Santa Barbara 


Statistical Physics of Particles is the welcome result of an innovative and popular graduate 
course Kardar has been teaching at MIT for almost twenty years. It is a masterful account of the 
essentials of a subject which played a vital role in the development of twentieth century physics, 
not only surviving, but enriching the development of quantum mechanics. Its importance to 
science in the future can only increase with the rise of subjects such as quantitative biology. 


Statistical Physics of Fields builds on the foundation laid by the Statistical Physics of Particles, 
with an account of the revolutionary developments of the past 35 years, many of which were 
facilitated by renormalization group ideas. Much of the subject matter is inspired by problems in 
condensed matter physics, with a number of pioneering contributions originally due to Kardar 
himself. This lucid exposition should be of particular interest to theorists with backgrounds in 
field theory and statistical mechanics. 

David R Nelson, Arthur K Solomon Professor of Biophysics, Harvard University 


If Landau and Lifshitz were to prepare a new edition of their classic Statistical Physics text they 
might produce a book not unlike this gem by Mehran Kardar. Indeed, Kardar is an extremely rare 
scientist, being both brilliant in formalism and an astoundingly careful and thorough teacher. He 
demonstrates both aspects of his range of talents in this pair of books, which belong on the 
bookshelf of every serious student of theoretical statistical physics. 


Kardar does a particularly thorough job of explaining the subtleties of theoretical topics too new 
to have been included even in Landau and Lifshitz’s most recent Third Edition (1980), such as 
directed paths in random media and the dynamics of growing surfaces, which are not in any text 
to my knowledge. He also provides careful discussion of topics that do appear in most modern 
texts on theoretical statistical physics, such as scaling and renormalization group. 

H Eugene Stanley, Director, Center for Polymer Studies, Boston University 


This is one of the most valuable textbooks I have seen in a long time. Written by a leader in the 
field, it provides a crystal clear, elegant and comprehensive coverage of the field of statistical 
physics. I’m sure this book will become “the” reference for the next generation of researchers, 
students and practitioners in statistical physics. I wish I had this book when I was a student but I 
will have the privilege to rely on it for my teaching. 
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Preface 


Historically, the discipline of statistical physics originated in attempts to 
describe thermal properties of matter in terms of its constituent particles, but 
also played a fundamental role in the development of quantum mechanics. 
More generally, the formalism describes how new behavior emerges from 
interactions of many degrees of freedom, and as such has found applications 
in engineering, social sciences, and increasingly in biological sciences. This 
book introduces the central concepts and tools of this subject, and guides 
the reader to their applications through an integrated set of problems and 
solutions. 

The material covered is directly based on my lectures for the first semester 
of an MIT graduate course on statistical mechanics, which I have been teaching 
on and off since 1988. (The material pertaining to the second semester is 
presented in a companion volume.) While the primary audience is physics 
graduate students in their first semester, the course has typically also attracted 
enterprising undergraduates. as well as students from a range of science and 
engineering departments. While the material is reasonably standard for books 
on statistical physics, students taking the course have found my exposition 
more useful, and have strongly encouraged me to publish this material. Aspects 
that make this book somewhat distinct are the chapters on probability and 
interacting particles. Probability is an integral part of statistical physics, which 
is not sufficiently emphasized in most textbooks. Devoting an entire chapter to 
this topic (and related issues such as the central limit theorem and information 
theory) provides valuable tools to the reader. In the context of interacting 
particles, I provide an extensive description of the van der Waals equation, 
including its derivation by mean-field approximation. 

An essential part of learning the material is doing problems; an interesting 
selection of problems (and solutions) has been designed and integrated into 
the text. Following each chapter there are two sets of problems: solutions to 
the first set are included at the end of the book, and are intended to introduce 
additional topics and to reinforce technical tools. Pursuing these problems 
should also prove useful for students studying for qualifying exams. There 
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are no solutions provided for a second set of problems, which can be used in 


assignments. 

Iam most grateful to my many former students for their help in formulating 
the material, problems, and solutions, typesetting the text and figures, and 
pointing out various typos and errors. The support of the National Science 


Foundation through research grants is also acknowledged. 


1 
Thermodynamics 


1.1 Introduction 


Thermodynamics is a phenomenological description of properties of macro- 
scopic systems in thermal equilibrium. 


Imagine yourself as a post-Newtonian physicist intent on understanding the 
behavior of such a simple system as a container of gas. How would you 
proceed? The prototype of a successful physical theory is classical mechanics, 
which describes the intricate motions of particles starting from simple basic 
laws and employing the mathematical machinery of calculus. By analogy, you 
may proceed as follows: 


© Idealize the system under study as much as possible (as is the case of a point 
particle). The concept of mechanical work on the system is certainly familiar, yet 
there appear to be complications due to exchange of heat. The solution is first to 
examine closed systems, insulated by adiabatic walls that don’t allow any exchange 
of heat with the surroundings. Of course, it is ultimately also necessary to study 
open systems, which may exchange heat with the outside world through diathermic 
walls. 

e As the state of a point particle is quantified by its coordinates (and momenta), proper- 
ties of the macroscopic system can also be described by a number of thermodynamic 
coordinates or state functions. The most familiar coordinates are those that relate 
to mechanical work, such as pressure and volume (for a fluid), surface tension and 
area (for a film), tension and length (for a wire), electric field and polarization (for 
a dielectric), etc. As we shall see, there are additional state functions not related to 
mechanical work. The state functions are well defined only when the system is in 
equilibrium, that is, when its properties do not change appreciably with time over 
the intervals of interest (observation times). The dependence on the observation time 
makes the concept of equilibrium subjective. For example, window glass is in equi- 
librium as a solid over many decades, but flows like a fluid over time scales of 
millennia. At the other extreme, it is perfectly legitimate to consider the equilibrium 
between matter and radiation in the early universe during the first minutes of the 


Big Bang. 


Fig. 1.1 Illustration of the 
zeroth law: systems A 
and B, which are initially 
separately in equilibrium 
with C, are placed in 
contact with each other. 


Thermodynamics 


e Finally, the relationship between the state functions is described by the laws of 
thermodynamics. As a phenomenological description, these laws are based on a 
number of empirical observations. A coherent logical and mathematical structure 
is then constructed on the basis of these observations, which leads to a variety of 
useful concepts, and to testable relationships among various quantities. The laws of 
thermodynamics can only be justified by a more fundamental (microscopic) theory 
of nature. For example, statistical mechanics attempts to obtain these laws starting 
from classical or quantum mechanical equations for the evolution of collections of 


particles. 


1.2 The zeroth law 


The zeroth law of thermodynamics describes the transitive nature of thermal 
equilibrium. It states: 


If two systems, A and B, are separately in equilibrium with a third system, C, 
then they are also in equilibrium with one another. 


Despite its apparent simplicity, the zeroth law has the consequence of implying 
the existence of an important state function, the empirical temperature ©, such 
that systems in equilibrium are at the same temperature. 
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adiabatic wall 


Let the equilibrium state of systems A, B, and C be described by the 
coordinates {A,,A,,---}, {B,,B),---}, and {C,,C,,---}, respectively. The 
assumption that A and C are in equilibrium implies a constraint between 
the coordinates of A and C, that is, a change in A, must be accompanied by 
some changes in {A,,---;C,,C,,---} to maintain equilibrium of A and C. 
Denote this constraint by 


Fac(Ai, Ags+++ 3 Ci, Cy, ++) =0. (1.1) 
The equilibrium of B and C implies a similar constraint 
fec(By, Bo, +++ 3 C,,Cy,---) =0. (1.2) 


Note that each system is assumed to be separately in mechanical equilibrium. 
If they are allowed also to do work on each other, additional conditions (e.g., 
constant pressure) are required to describe their joint mechanical equilibrium. 
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Clearly we can state the above constraint in many different ways. For example, 
we can study the variations of C, as all of the other parameters are changed. 
This is equivalent to solving each of the above equations for C, to yield ' 


Cy = Fac(Ay, Ao, +++ 3 Ca++), 


(1.3) 
C; = Fec(By, By, +++ 3 Cy, +++). 
Thus if C is separately in equilibrium with A and B, we must have 
Fac(Ay, Ags +++ 3 Ca++ +) = Fee (By, Ba, ++ 3 Cy, +++). (1.4) 


However, according to the zeroth law there is also equilibrium between 
A and B, implying the constraint 


FaplAy, Ao,*++ 3 By, By, +++) =0. (1.5) 


We can select any set of parameters {A, B} that satisfy the above equation, and 
substitute them in Eq. (1.4). The resulting equality must hold quite indepen- 
dently of any set of variables {C} in this equation. We can then change these 
parameters, moving along the manifold constrained by Eq. (1.5), and Eq. (1.4) 
will remain valid irrespective of the state of C. Therefore, it must be possible 
to simplify Eq. (1.4) by canceling the coordinates of C. Alternatively, we can 
select any fixed set of parameters C, and ignore them henceforth, reducing the 
condition (1.5) for equilibrium of A and B to 


©,(A,, Ag, -++) = Og(B,, By, +++), (1.6) 


that is, equilibrium is characterized by a function © of thermodynamic coor- 
dinates. This function specifies the equation of state, and isotherms of A are 
described by the condition ©,(A,, A;,---) = ©. While at this point there are 
many potential choices of @, the key point is the existence of a function that 
constrains the parameters of each system in thermal equilibrium. 

There is a similarity between © and the force in a mechanical system. 
Consider two one-dimensional systems that can do work on each other as 
in the case of two springs connected together. Equilibrium is achieved when 
the forces exerted by each body on the other are equal. (Of course, unlike 
the scalar temperature, the vectorial force has a direction; a complication that 
we have ignored. The pressure of a gas piston provides a more apt analogy.) 
The mechanical equilibrium between several such bodies is also transitive, and 
the latter could have been used as a starting point for deducing the existence 
of a mechanical force. 


' From a purely mathematical perspective, it is not necessarily possible to solve an arbitrary 
constraint condition for C,. However, the requirement that the constraint describes real physical 
parameters clearly implies that we can obtain C, as a function of the remaining parameters. 


Fig. 1.2 Equilibria of a 
gas (A) and a magnet (B), 
and a gas (A) and a 

wire (C). 
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As an example, let us consider the following three systems: (A) a wire of 
length L with tension F, (B) a paramagnet of magnetization M in a magnetic 
field B, and (C) a gas of volume V at pressure P. 


+ [| 4B M 
L beg 
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Observations indicate that when these systems are in equilibrium, the fol- 
lowing constraints are satisfied between their coordinates: 


(P+ 5) (vob — Ly) el —K(L— Ly) =0, 


; (1.7) 
(P+ a) (V—b)M—dB=0. 


The two conditions can be organized into three empirical temperature func- 
tions as 


Ox (P+, )V-B=e( K)=45. (1.8) 


Note that the zeroth law severely constrains the form of the constraint equa- 
tion describing the equilibrium between two bodies. Any arbitrary function 
cannot necessarily be organized into an equality of two empirical temperature 
functions. 

The constraints used in the above example were in fact chosen to reproduce 
three well-known equations of state that will be encountered and discussed 
later in this book. In their more familiar forms they are written as 


f (P+a/V*)(V — b) = NkpT (van der Waals gas) 
M =(N w,B)/(3kgT) (Curie paramagnet) : (1.9) 
t F =(K+DT)(L—L,) (Hooke’s law for rubber) 


Note that we have employed the symbol for Kelvin temperature 7, in place of 
the more general empirical temperature ©. This concrete temperature scale can 
be constructed using the properties of the ideal gas. 

The ideal gas temperature scale: while the zeroth law merely states the 
presence of isotherms, to set up a practical temperature scale at this stage, a 
reference system is necessary. The ideal gas occupies an important place in 
thermodynamics and provides the necessary reference. Empirical observations 
indicate that the product of pressure and volume is constant along the isotherms 
of any gas that is sufficiently dilute. The ideal gas refers to this dilute limit of 
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0 
0 273.16K T 


real gases, and the ideal gas temperature is proportional to the product. The 
constant of proportionality is determined by reference to the temperature of the 
triple point of the ice-water—-gas system, which was set to 273.16 (degrees) 
kelvin (K) by the 10th General Conference on Weights and Measures in 1954. 
Using a dilute gas (i.e., as P > 0) as thermometer, the temperature of a system 
can be obtained from 


T(K) = 273.16 x (Jim (PV) sem/ Jim (PV) ice-wateress) - (1.10) 


1.3 The first law 


In dealing with simple mechanical systems, conservation of energy is an impor- 
tant principle. For example, the location of a particle can be changed in a 
potential by external work, which is then related to a change in its potential 
energy. Observations indicate that a similar principle operates at the level of 
macroscopic bodies provided that the system is properly insulated, that is, when 
the only sources of energy are of mechanical origin. We shall use the following 
formulation of these observations: 


The amount of work required to change the state of an otherwise adiabatically 
isolated system depends only on the initial and final states, and not on the 
means by which the work is performed, or on the intermediate stages through 
which the system passes. 


For a particle moving in a potential, the required work can be used to construct 
a potential energy landscape. Similarly, for the thermodynamic system we can 
construct another state function, the internal energy E(X). Up to a constant, 


Fig. 1.3 The triple 

point of ice, water, and 
steam occurs at a unique 
point in the (P, T) phase 
diagram. 


Fig. 1.4 The two adiabatic 
paths for changing 
macroscopic coordinates 
between the initial and 
final point result in the 
same change in internal 
energy. 
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E(X) can be obtained from the amount of work AW needed for an adiabatic 
transformation from an initial state X; to a final state X», using 


AW = E(X;) — E(X,). (1.11) 


Another set of observations indicate that once the adiabatic constraint is 
removed, the amount of work is no longer equal to the change in the internal 
energy. The difference AQ = AE — AW is defined as the heat intake of the 
system from its surroundings. Clearly, in such transformations, AQ and AW 
are not separately functions of state in that they depend on external factors such 
as the means of applying work, and not only on the final states. To emphasize 
this, for a differential transformation we write 


dQ =dE-—4dw, (1.12) 


where dE = 0, 0,EdX; can be obtained by differentiation, while dQ and dW 
generally cannot. Also note that our convention is such that the signs of work 
and heat indicate the energy added to the system, and not vice versa. The first 
law of thermodynamics thus states that to change the state of a system we 
need a fixed amount of energy, which can be in the form of mechanical work 
or heat. This can also be regarded as a way of defining and quantifying the 
exchanged heat. 

A quasi-static transformation is one that is performed sufficiently slowly 
so that the system is always in equilibrium. Thus, at any stage of the process, 
the thermodynamic coordinates of the system exist and can in principle be 
computed. For such transformations, the work done on the system (equal in 
magnitude but opposite in sign to the work done by the system) can be related to 
changes in these coordinates. As a mechanical example, consider the stretching 
of a spring or rubber band. To construct the potential energy of the system 
as a function of its length L, we can pull the spring sufficiently slowly so 
that at each stage the external force is matched by the internal force F from 
the spring. For such a quasi-static process, the change in the potential energy 
of the spring is f FdL. If the spring is pulled abruptly, some of the external 
work is converted into kinetic energy and eventually lost as the spring comes 
to rest. 

Generalizing from the above example, one can typically divide the state func- 
tions {X} into a set of generalized displacements {x}, and their conjugate gen- 
eralized forces {J}, such that for an infinitesimal quasi-static transformation* 


dW => J,dx,. (1.13) 


2 T denote force by the symbol J rather than F, to reserve the latter for the free energy. I hope 
the reader is not confused with currents (sometimes also denoted by J), which rarely appear in 
this book. 
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Table 1.1 Generalized forces and displacements 


System Force Displacement 

Wire tension F length L 
Film surface tension 5 area A 
Fluid pressure —P volume V 
Magnet magnetic field H magnetization M 
Dielectric electric field E polarization P 
Chemical reaction chemical potential wb particle number JN 


Table |.1 provides some common examples of such conjugate coordinates. 
Note that pressure P is by convention calculated from the force exerted by the 
system on the walls, as opposed to the force on a spring, which is exerted in 
the opposite direction. This is the origin of the negative sign that accompanies 
hydrostatic work. 

The displacements are usually extensive quantities, that is, proportional to 
system size, while the forces are intensive and independent of size. The latter 
are indicators of equilibrium; for example, the pressure is uniform in a gas in 
equilibrium (in the absence of external potentials) and equal for two equilibrated 
gases in contact. As discussed in connection with the zeroth law, temperature 
plays a similar role when heat exchanges are involved. Is there a corresponding 
displacement, and if so what is it? This question will be answered in the 
following sections. 

The ideal gas: we noted in connection with the zeroth law that the equation 
of state of the ideal gas takes a particularly simple form, PV « T. The internal 
energy of the ideal gas also takes a very simple form, as observed for example 
by Joule’s free expansion experiment: measurements indicate that if an ideal 
gas expands adiabatically (but not necessarily quasi-statically), from a volume 
V; to V,, the initial and final temperatures are the same. As the transformation 
is adiabatic (AQ = 0) and there is no external work done on the system (AW = 
0), the internal energy of the gas is unchanged. Since the pressure and volume 
of the gas change in the process, but its temperature does not, we conclude that 
the internal energy depends only on temperature, that is, E(V, T) = E(T ). This 
property of the ideal gas is in fact a consequence of the form of its equation of 
state, as will be proved in one of the problems at the end of this chapter. 


Fig. 1.5 A gas initially 
confined in the left 
chamber is allowed to 
expand rapidly to both 
chambers. 
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Response functions are the usual method for characterizing the macroscopic 
behavior of a system. They are experimentally measured from the changes 
of thermodynamic coordinates with external probes. Some common response 
functions are as follows. 

Heat capacities are obtained from the change in temperature upon addition 
of heat to the system. Since heat is not a function of state, the path by which 
it is supplied must also be specified. For example, for a gas we can calculate 
the heat capacities at constant volume or pressure, denoted by Cy = dQ/dT|, 
and Cp = dQ/dT|,, respectively. The latter is larger since some of the heat is 
used up in the work done in changes of volume: 


_ dQ| _ dE-aW| _ aeray _ 8 


c, = 20) _ B= aw | | 
dT \y dT jy dT lv oT \y 
d dE—dw dE+ PdV OE Ov 

Cp = Q = = = +P : (1.14) 
dT |, dT 2 dT p OT |p OT |p 


Force constants measure the (infinitesimal) ratio of displacement to force 
and are generalizations of the spring constant. Examples include the isothermal 
compressibility of a gas kK; = — 0V/dP|,/V, and the susceptibility of a magnet 
Xr = 0M/0B|,/V. From the equation of state of an ideal gas PV «x T, we 
obtain Kk; = 1/P. 

Thermal responses probe the change in the thermodynamic coordinates 
with temperature. For example, the expansivity of a gas is given by ap = 
OV/dT|p/V, which equals 1/T for the ideal gas. 

Since the internal energy of an ideal gas depends only on its temperature, 
JE /0T|, = 0E/0T|p = dE/dT, and Eq. (1.14) simplifies to 

Cp Cy =P S| = Play = = My (1.15) 
The last equality follows from extensivity: for a given amount of ideal gas, 
the constant PV/T is proportional to N, the number of particles in the gas; the 
ratio is Boltzmann’s constant with a value of k, * 1.4 x 10-2 JK7'. 


1.4 The second law 


The practical impetus for development of the science of thermodynamics in 
the nineteenth century was the advent of heat engines. The increasing reliance 
on machines to do work during the industrial revolution required better under- 
standing of the principles underlying conversion of heat to work. It is quite 
interesting to see how such practical considerations as the efficiency of engines 
can lead to abstract ideas like entropy. 

An idealized heat engine works by taking in a certain amount of heat Q,,, 
from a heat source (for example a coal fire), converting a portion of it to work 
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W, and dumping the remaining heat Q-, into a heat sink (e.g., atmosphere). 
The efficiency of the engine is calculated from 


na 2 = uae 2, (1.16) 


Qu Qu 
An idealized refrigerator is like an engine running backward, that is, using 
work W to extract heat Q- from a cold system, and dumping heat Q,, at a higher 
temperature. We can similarly define a figure of merit for the performance of 
a refrigerator as 


pee. et (1.17) 
W Qu-Qc 
y Qu Qn 
Engine }-}—>— W WwW >— Refrigerator 
VQc Q 
<—“Ice-box > 


The first law rules out so-called “perpetual motion machines of the first 
kind,” that is, engines that produce work without consuming any energy. How- 
ever, the conservation of energy is not violated by an engine that produces 
work by converting water to ice. Such a “perpetual motion machine of the 
second kind” would certainly solve the world’s energy problems, but is ruled 
out by the second law of thermodynamics. The observation that the natural 
direction for the flow of heat is from hotter to colder bodies is the essence of 
the second law of thermodynamics. There is a number of different formulations 
of the second law, such as the following two statements: 


Kelvin’s statement. No process is possible whose sole result is the complete 
conversion of heat into work. 


Clausius’s statement. No process is possible whose sole result is the transfer 
of heat from a colder to a hotter body. 


A perfect engine is ruled out by the first statement, a perfect refrigerator by 
the second. Since we shall use both statements, we first show that they are 
equivalent. Proof of the equivalence of the Kelvin and Clausius statements 
proceeds by showing that if one is violated, so is the other. 


(a) Let us assume that there is a machine that violates Clausius’s statement by taking 
heat Q from a cooler region to a hotter one. Now consider an engine operating 
between these two regions, taking heat Q,, from the hotter one and dumping Q; at 
the colder sink. The combined system takes Q,, — Q from the hot source, produces 


work equal to Q;, — Qc, and dumps Q- — Q at the cold sink. If we adjust the engine 


Fig. 1.6 The idealized 
engine and refrigerator. 
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Fig. 1.7 A machine 
violating Clausius’s 
statement (C) can be 
connected to an engine, 
resulting in a combined 
device (K) that violates 
Kelvin’s statement. 


Fig. 1.8 A machine 
violating Kelvin’s 
statement can be 
connected to a 
refrigerator, resulting in 
violation of Clausius’s 
statement. 


Fig. 1.9 A Carnot engine 
operates between 
temperatures 7, and Tc, 
with no other heat 
exchanges. 


Thermodynamics 


output such that O- = Q, the net result is a 100% efficient engine, in violation of 


Kelvin’s statement. 


hot hot 
AO Y Qu Qn- Qc 
Cc Engine +> W = Ww 


(b) Alternatively, assume a machine that violates Kelvin’s law by taking heat Q and 
converting it completely to work. The work output of this machine can be used to 
run a refrigerator, with the net outcome of transferring heat from a colder to a hotter 


body, in violation of Clausius’s statement. 


hot —————._— hot 
Y @2 AN Qu “YN Qy-Q 
= Ww = 
K + >——>— Refrigerator = Ce) 
VAN Oc “N Qc 
cold 


1.5 Carnot engines 


A Carnot engine is any engine that is reversible, runs in a cycle, with all 
of its heat exchanges taking place at a source temperature T,, and a sink 
temperature To. 


Ty 
¥ 
Tc 


A reversible process is one that can be run backward in time by simply revers- 
ing its inputs and outputs. It is the thermodynamic equivalent of frictionless 
motion in mechanics. Since time reversibility implies equilibrium, a reversible 
transformation must be quasi-static, but the reverse is not necessarily true (e.g., 
if there is energy dissipation due to friction). An engine that runs in a cycle 


1.5 Carnot engines 


returns to its original internal state at the end of the process. The distinguishing 
characteristic of the Carnot engine is that heat exchanges with the surroundings 
are carried out only at two temperatures. 

The zeroth law allows us to select two isotherms at temperatures 7, and 
Tc for these heat exchanges. To complete the Carnot cycle we have to connect 
these isotherms by reversible adiabatic paths in the coordinate space. Since 
heat is not a function of state, we don’t know how to construct such paths in 
general. Fortunately, we have sufficient information at this point to construct 
a Carnot engine using an ideal gas as its internal working substance. For the 
purpose of demonstration, let us compute the adiabatic curves for a monatomic 
ideal gas with an internal energy 


E= 3 NkpT “py 
2 a 


Along a quasi-static path 


3 5 3 
ag =de—aw =a (5p) +Pav= 3 Pav+ gyn: (1.18) 
The adiabatic condition dQ = 0, then implies a path 
dP 5dV 
-P + 3 = 0, = > PV*’=constant, (1.19) 


with y = 5/3. 


adiabatics (AQ =0) 
1 \ 


The adiabatic curves are clearly distinct from the isotherms, and we can 
select two such curves to intersect our isotherms, thereby completing a Carnot 
cycle. The assumption of E « T is not necessary, and in one of the problems 
provided at the end of this chapter, you will construct adiabatics for any E(T). 
In fact, a similar construction is possible for any two-parameter system with 
E(J, x). 


Carnot’s theorem No engine operating between two reservoirs (at temper- 
atures T,, and Tc) is more efficient than a Carnot engine operating between 
them. 
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Fig. 1.10 The Carnot 
cycle for an ideal gas, 
with isothermal and 
adiabatic paths indicated 
by solid and dashed 
lines, respectively. 
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Fig. 1.11 A generic 
engine is used to runa 
Carnot engine in reverse. 


Fig. 1.12 Two Carnot 
engines connected in 
series are equivalent to a 
third. 
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Since a Carnot engine is reversible, it can be run backward as a refrigerator. 
Use the non-Carnot engine to run the Carnot engine backward. Let us denote 
the heat exchanges of the non-Carnot and Carnot engines by Oy, Qc, and Q),, 
Q¢, respectively. The net effect of the two engines is to transfer heat equal to 
Oy — QO, = Oc — Qe, from T, to T~. According to Clausius’s statement, the 
quantity of transferred heat cannot be negative, that is, Q,, > Q),. Since the 
same quantity of work W is involved in this process, we conclude that 


W Ww 
On = On ’ = Ncarnot = Mnon-Carnot* (1.20) 
Ty 
bd Qu aN On Qy-Qn 
cE LW cE eC 
Y Oc  O¢ Oc-O¢ 
T¢ 


Corollary All reversible (Carnot) engines have the same universal efficiency 
(TT, Tc), since each can be used to run any other one backward. 

The thermodynamic temperature scale: as shown earlier, it is at least theo- 
retically possible to construct a Carnot engine using an ideal gas (or any other 
two-parameter system) as working substance. We now find that independent of 
the material used, and design and construction, all such cyclic and reversible 
engines have the same maximum theoretical efficiency. Since this maximum 
efficiency is only dependent on the two temperatures, it can be used to con- 
struct a temperature scale. Such a temperature scale has the attractive property 


T; -—— —_ T; 
YQ 
CE P-Wr Y Q, 
T> Y DQ = CE D— Wi3= Wi + Wo3 
Y Q 
CE P- W233 YQ 
is yes —_4 a 


of being independent of the properties of any material (e.g., the ideal gas). To 
construct such a scale we first obtain a constraint on the form of (Ty, Tc). 
Consider two Carnot engines running in series, one between temperatures 7, 
and 7,, and the other between 7, and 7; (7, > T, > T;). Denote the heat 
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exchanges, and work outputs, of the two engines by Q,, Q,, Wj2, and Q,, 
Q;, W 3, respectively. Note that the heat dumped by the first engine is taken 
in by the second, so that the combined effect is another Carnot engine (since 
each component is reversible) with heat exchanges Q,, Q3, and work output 
Wi3 = Wi + Wy3. 

Using the universal efficiency, the three heat exchanges are related by 


Q, = Q, — Wi, = Q,[1— (7), T>)], 
Q; = Q) — Wo; = Q.[1 — H(Tp, T3)] = Qi) — nT, T) J — n(7r, T)], 
(o,= ,- Ws = O07. 291 
Comparison of the final two expressions yields 
[1— (7, T3)] = [1 — (7), T) JU — (Tp, T3)]. (1.21) 


This property implies that 1— n(7,, T,) can be written as a ratio of the form 
S(T>)/f(1,), which by convention is set to T,/T,, that is, 


QO, T. 
Lala) =e = ge 
1 1 

Ty—Te 


=> (Tx Te) = 
A 


Equation (1.22) defines temperature up to a constant of proportionality, which 
is again set by choosing the triple point of water, ice, and steam to 273.16K. 
So far we have used the symbols © and T interchangeably. In fact, by running 
a Carnot cycle for a perfect gas, it can be proved (see problems) that the 
ideal gas and thermodynamic temperature scales are equivalent. Clearly, the 
thermodynamic scale is not useful from a practical standpoint; its advantage 
is conceptual, in that it is independent of the properties of any substance. 
All thermodynamic temperatures are positive, since according to Eq. (1.22) 
the heat extracted from a temperature T is proportional to it. If a negative 
temperature existed, an engine operating between it and a positive temperature 
would extract heat from both reservoirs and convert the sum total to work, in 
violation of Kelvin’s statement of the second law. 


(1.22) 
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To construct finally the state function that is conjugate to temperature, we 
appeal to the following theorem: 


Clausius’s theorem = For any cyclic transformation (reversible or not), 
f 4Q/T <0, where 4Q is the heat increment supplied to the system at temper- 
ature T. 


Subdivide the cycle into a series of infinitesimal transformations in which the 
system receives energy in the form of heat dQ and work dW. The system 
need not be in equilibrium at each interval. Direct all the heat exchanges 
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Fig. 1.13 The heat 
exchanges of the system 
are directed to a Carnot 
engine with a 

reservoir at To. 
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—_ T, 
YdQp 9 
CCE) > dW, 
dQ =” 
aw 


of the system to one port of a Carnot engine, which has another reservoir at a 
fixed temperature Ty. (There can be more than one Carnot engine as long as 
they all have one end connected to Ty.) Since the sign of dQ is not specified, the 
Carnot engine must operate a series of infinitesimal cycles in either direction. 
To deliver heat dQ to the system at some stage, the engine has to extract heat 
dQ, from the fixed reservoir. If the heat is delivered to a part of the system 
that is locally at a temperature T, then according to Eq. (1.22), 


d 
dO, = i (1.23) 


After the cycle is completed, the system and the Carnot engine return to 
their original states. The net effect of the combined process is extracting heat 
On = f AQ from the reservoir and converting it to external work W. The work 
W = Q, is the sum total of the work elements done by the Carnot engine, and 
the work performed by the system in the complete cycle. By Kelvin’s statement 
of the second law, OQ, = W <0, that is, 


dQ dQ 
Ty f = <0, = $= <0, (1.24) 


since T) > 0. Note that T in Eq. (1.24) refers to the temperature of the whole 

system only for quasi-static processes in which it can be uniquely defined 

throughout the cycle. Otherwise, it is just a local temperature (say at a boundary 

of the system) at which the Carnot engine deposits the element of heat. 
Consequences of Clausius’s theorem: 


1. For a reversible cycle ~ dO 
dQ... > —dQ 


rev rev? 


/T =0, since by running the cycle in the opposite direction 


rev 


and by the above theorem dQ... /T is both non-negative and non-positive, 


rev 


hence zero. This result implies that the integral of dQ,..,/T between any two points A and 


B is independent of path, since for two paths (1) and (2) 


Bao pA aa ag 8 aa 
4 i G5 / = | 1.25 
I, T, B Ty A T, A Ty (1.25) 


2. Using Eq. (1.25) we can construct yet another function of state, the entropy S. Since the 


integral is independent of path, and only depends on the two end-points, we can set 


S(B) — S(A) = i : a (1.26) 
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dQrey 


(b) 


= TdS. This allows us to 


construct adiabatic curves for a general (multivariable) system from the condition of constant 


For reversible processes, we can now compute the heat from dQ 


rev 


S. Note that Eq. (1.26) only defines the entropy up to an overall constant. 
. For a reversible (hence quasi-static) transformation, dQ = TdS and dW = )°;, J,dx;, and 


the first law implies 
dE =d0+dW =TdS+)-J,dx;. (1.27) 


We can see that in this equation S and T appear as conjugate variables, with S play- 
ing the role of a displacement, and T as the corresponding force. This identification 
allows us to make the correspondence between mechanical and thermal exchanges more 
precise, although we should keep in mind that unlike its mechanical analog, tempera- 
ture is always positive. While to obtain Eq. (1.27) we had to appeal to reversible trans- 
formations, it is important to emphasize that it is a relation between functions of state. 
Equation (1.27) is likely the most fundamental and useful identity in thermodynamics. 

. The number of independent variables necessary to describe a thermodynamic system also 
follows from Eq. (1.27). If there are n methods of doing work on a system, represented 
by n conjugate pairs (J;, x;), then n+ 1 independent coordinates are necessary to describe 
the system. (We shall ignore possible constraints between the mechanical coordinates.) 
For example, choosing (E, {x;}) as coordinates, it follows from Eq. (1.27) that 

os 1 os J; 


OB) i220. ges gee 1.28 
et ele ee) 
bake 


Bete 
i Bo 


. Consider an irreversible change from A to B. Make a complete cycle by returning from 


B to A along a reversible path. Then 
Bd Ad Bd 
fBef Se <0, = [oS <sia-sa). (1.29) 
A T BOT aA T 


In differential form, this implies that dS > dQ/T for any transformation. In particular, 


consider adiabatically isolating a number of subsystems, each initially separately in equi- 
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Fig. 1.14 (a) A reversible 
cycle. (b) Two reversible 
paths between A and B. 
(c) The cycle formed from 
a generic path between A 
and B, and a reversible 
one. 


Fig. 1.15 The initially 
isolated subsystems are 
allowed to interact, 
resulting in an increase of 
entropy. 
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Fig. 1.16 Mechanical 
equilibrium of an 
extended spring. 
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librium. As they come to a state of joint equilibrium, since the net d(Q = 0, we must have 
6S > 0. Thus an adiabatic system attains a maximum value of entropy in equilibrium since 
spontaneous internal changes can only increase S. The direction of increasing entropy 
thus points out the arrow of time, and the path to equilibrium. The mechanical analog is 
a point mass placed on a surface, with gravity providing a downward force. As various 
constraints are removed, the particle will settle down at locations of decreasing height. The 
statement about the increase of entropy is thus no more mysterious than the observation 
that objects tend to fall down under gravity! 


1.7 Approach to equilibrium and thermodynamic 
potentials 


The time evolution of systems toward equilibrium is governed by the second 
law of thermodynamics. For example, in the previous section we showed that 
for an adiabatically isolated system entropy must increase in any spontaneous 
change and reaches a maximum in equilibrium. What about out-of-equilibrium 
systems that are not adiabatically isolated, and may also be subject to exter- 
nal mechanical work? It is usually possible to define other thermodynamic 
potentials that are extremized when the system is in equilibrium. 


Enthalpy is the appropriate function when there is no heat exchange (dQ = 
0), and the system comes to mechanical equilibrium with a constant external 
force. The minimum enthalpy principle merely formulates the observation that 
stable mechanical equilibrium is obtained by minimizing the net potential 
energy of the system plus the external agent. 

For example, consider a spring of natural extension L, and spring constant 
K, subject to the force J = mg exerted by a particle of mass m. For an extension 
x = L—Lp, the internal potential energy of the spring is U(x) = Kx?/2, while 
there is a change of —mgx in the potential energy of the particle. Mechanical 
equilibrium is obtained by minimizing Kx’/2—mgx at an extension Xeq = 
mg/K. The spring at any other value of the displacement initially oscillates 
before coming to rest at x,, due to friction. For a more general potential energy 
U(x), the internally generated force J; = —dU/dx has to be balanced with the 
external force J at the equilibrium point. 

For any set of displacements x, at constant (externally applied) generalized 
forces J, the work input to the system is dW < J- 6x. (Equality is achieved 
for a quasi-static change with J = J,, but there is generally some loss of the 
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external work to dissipation.) Since dQ = 0, using the first law, 6E < J- 6x, 
and 


6H <0, where H=E-J-x (1.30) 
is the enthalpy. The variations of H in equilibrium are given by 
dH =dE—d(J-x) = TdS+J-dx—x-dJ—J-dx = TdS —x-dJ. (1.31) 


The equality in Eq. (1.31), and the inequality in Eq. (1.30), are a possible 
source of confusion. Equation (1.30) refers to variations of H on approaching 
equilibrium as some parameter that is not a function of state is varied (e.g., the 
velocity of the particle joined to the spring in the above example). By contrast, 
Eq. (1.31) describes a relation between equilibrium coordinates. To differentiate 
the two cases, I will denote the former (non-equilibrium) variations by 6. 
The coordinate set (S, J) is the natural choice for describing the enthalpy, 
and it follows from Eq. (1.31) that 
0H 
ee) / 


I 


(1.32) 


SJ 
Variations of the enthalpy with temperature are related to heat capacities at 
constant force, for example 


_ dQ| _ dE+Pdav 


_ d(E+PV) 
~ dT dT ~ 


dT 


_ dH 


Cc = 
. dT 


(1.33) 


P P P P 
Note, however, that a change of variables is necessary to express H in terms 
of 7, rather than the more natural variable S. 

Helmholtz free energy is useful for isothermal transformations in the 
absence of mechanical work (dW = 0). It is rather similar to enthalpy, with 
T taking the place of J. From Clausius’s theorem, the heat intake of a system 
at a constant temperature T satisfies dQ < T6S. Hence 6E = dQ+dW < T6S, 


and 
6F <0, where F=E-TS (1.34) 
is the Helmholtz free energy. Since 
dF = dE-d(TS) = TdS + J-dx — SdT — TdS = —SdT +J- dx, (1.35) 


the coordinate set (T,x) (the quantities kept constant during an isothermal 
transformation with no work) is most suitable for describing the free energy. 
The equilibrium forces and entropy can be obtained from 


OF OF 
i= — , S=- — (1.36) 
OX; |r x. oT |, 
A jAi 
The internal energy can also be calculated from F' using 
OF OF; 
E=F+TS=F-T | =-7T ef) (1.37) 
aT |, aT i, 
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Table 1.2 Inequalities satisfied by thermodynamic potentials 


dQ=0 constant T 
dw=0 6S>0 oF <0 
constant J 6H <0 6G <0 


Gibbs free energy applies to isothermal transformations involving mechan- 
ical work at constant external force. The natural inequalities for work and 
heat input into the system are given by dW < J- 6x and dQ < T6S. Hence 
bE < T6S+J- 6x, leading to 


6G <0, where G=E-TS-—J-x (1.38) 


is the Gibbs free energy. Variations of G are given by 


dG = dE —d(TS) —d(J-x) = TdS + J- dx — SdT — TdS —x-dJ —J-dx 


= -—SdT —x-dJ, (1.39) 


and most easily expressed in terms of (T, J). 

Table |.2 summarizes the above results on thermodynamic functions. Equa- 
tions (1.30), (1.34), and (1.38) are examples of Legendre transformations, used 
to change variables to the most natural set of coordinates for describing a 
particular situation. 

So far, we have implicitly assumed a constant number of particles in the sys- 
tem. In chemical reactions, and in equilibrium between two phases, the number 
of particles in a given constituent may change. The change in the number of 
particles necessarily involves changes in the internal energy, which is expressed 
in terms of a chemical work dW = w-dN. Here N = {N,, N5,---} lists the 
number of particles of each species, and w= {,, 2,---} the associated chem- 
ical potentials that measure the work necessary to add additional particles to 
the system. Traditionally, chemical work is treated differently from mechanical 
work and is not subtracted from E in the Gibbs free energy of Eq. (1.38). For 
chemical equilibrium in circumstances that involve no mechanical work, the 
appropriate state function is the grand potential given by 


G=E-TS-wN. (1.40) 


S(T, w, X) is minimized in chemical equilibrium, and its variations in general 
satisfy 


dG =—SdT+J-dx—N- dy. (1.41) 


Example. To illustrate the concepts of this section, consider N particles of 
supersaturated steam in a container of volume V at a temperature 7. How can 
we describe the approach of steam to an equilibrium mixture with N,, particles 
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in the liquid and JN, particles in the gas phase? The fixed coordinates describing 
this system are V, T, and N. The appropriate thermodynamic function from 
Table 1.2 is the Helmholtz free energy F(V, T, N), whose variations satisfy 


dF = d(E—TS) = —SdT — PdV + pdN. (1.42) 


VN 


Before the system reaches equilibrium at a particular value of N, 


wy, it goes 
through a series of non-equilibrium states with smaller amounts of water. If 
the process is sufficiently slow, we can construct an out-of-equilibrium value 


for F as 
FV, T, N|N,) = Fy(T. Ny) + F,(V, T, N—N,), (1.43) 


which depends on an additional variable N,,. (It is assumed that the volume 
occupied by water is small and irrelevant.) According to Eq. (1.34), the equi- 
librium point is obtained by minimizing F with respect to this variable. Since 


OF, 
6F= — 
ON, 


w 


hs (1.44) 


TV 
and 0F/dN|,y =m from Eq. (1.42), the equilibrium condition can be obtained 
by equating the chemical potentials, that is, from w,,(V,7T) = p,(V, T ). 


The identity of chemical potentials is the condition for chemical equilibrium. 
Naturally, to proceed further we need expressions for w,, and p,. 
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Fig. 1.17 Condensation of 
water from 
supersaturated steam. 


Fig. 1.18 The net free 
energy has a minimum 
as a function of the 
amount of water. 
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1.8 Useful mathematical results 


In the preceding sections we introduced a number of state functions. However, 
if there are n ways of doing mechanical work, n+ 1 independent parameters 
suffice to characterize an equilibrium state. There must thus be various con- 
straints and relations between the thermodynamic parameters, some of which 
are explored in this section. 

(1) Extensivity: including chemical work, variations of the extensive coor- 
dinates of the system are related by (generalizing Eq. (1.27)) 


dE =TdS+J-dx+p-dN. (1.45) 


For fixed intensive coordinates, the extensive quantities are simply propor- 
tional to size or to the number of particles. This proportionality is expressed 
mathematically by 


E(AS, Ax, AN) = AE(S, x, N). (1.46) 


Evaluating the derivative of the above equation with respect to A at A= 1 
results in 


dE | dE | 


N, = E(S,x,N). (1.47) 


=; S+),— x;+ 

x, 2 Ox; Isao 2 ONa | see 
The partial derivatives in the above equation can be identified from Eq. (1.45) 
as T, J;, and 1, respectively. Substituting these values into Eq. (1.47) leads to 


E=TS+J-x+p-N. (1.48) 


Combining the variations of Eq. (1.48) with Eq. (1.45) leads to a constraint 
between the variations of intensive coordinates 


SdT7+x-dJ+N-du=0, (1.49) 


known as the Gibbs—Duhem relation. While Eq. (1.48) is sometimes referred 
to as the “fundamental equation of thermodynamics,” I regard Eq. (1.45) as the 
more fundamental. The reason is that extensivity is an additional assumption, 
and in fact relies on short-range interactions between constituents of the system. 
It is violated for a large system controlled by gravity, such as a galaxy, while 
Eq. (1.45) remains valid. 

Example. For a fixed amount of gas, variations of the chemical potential 
along an isotherm can be calculated as follows. Since dT = 0, the Gibbs—Duhem 
relation gives -VdP+ Ndu = 0, and 


V dP 
du = —dP =k,T—, 1.50 
N ae, ae, 
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where we have used the ideal gas equation of state PV = Nk,T. Integrating 
the above equation gives 


P V 
B= Po tkpT In — = py —kgTIn—, (1.51) 
Po Yo 


where (Po, Vo, Mo) refer to the coordinates of a reference point. 

(2) Maxwell relations. Combining the mathematical rules of differentiation 
with thermodynamic relationships leads to several useful results. The most 
important of these are Maxwell’s relations, which follow from the commutative 
property [0,0,f (x, y) = 0,0,f (x, y)] of derivatives. For example, it follows 
from Eq. (1.45) that 


OE | OE | 
— =T, and — =J;. (1.52) 
as len Ox; Isao 
The joint second derivative of E is then given by 
PE PE oT OJ; 
= — (1.53) 


ASdx,  Ax,0S—Ax;|s_— S|, 
Since (dy/dx) = (dx/dy)~!, the above equation can be inverted to give 


as 
ad; 


Ox; 
~ aT 


Xj 


(1.54) 


S 

Similar identities can be obtained from the variations of other state functions. 
Supposing that we are interested in finding an identity involving 0S/dx|,. We 
would like to find a state function whose variations include SdT and Jdx. 
The correct choice is dF = d(E — TS) = —SdT + Jdx. Looking at the second 
derivative of F yields the Maxwell relation 


= —|. (1.55) 


To calculate 0S/dJ|,, consider d(E — TS — Jx) = —SdT — xdJ, which leads to 
the identity 


os 
oJ 


_ Ox 


La (1.56) 
ae) 


J 
There is a variety of mnemonics that are supposed to help you remember and 
construct Maxwell relations, such as magic squares, Jacobians, etc. I personally 
don’t find any of these methods worth learning. The most logical approach 
is to remember the laws of thermodynamics and hence Eq. (1.27), and then 
to manipulate it so as to find the appropriate derivative using the rules of 
differentiation. 

Example. To obtain du/0P|,, , for an ideal gas, start with d((E— TS+ PV) = 
—SdT+VdP+ dN. Clearly 
Vs okgT 


== 4) (1.57) 
T,P N P 


Of 
aP 


_ Vv 
vr ON 
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as in Eq. (1.50). From Eq. (1.27) it also follows that 


as P —— AE/AV\s.v 


—4 — > 1.58 
Viey T JE/0S|y.y (158) 


where we have used Eq. (1.45) for the final identity. The above equation can 
be rearranged into 


os 
ov 


OE 
en OS 


ov 
vn OF 


=-1, (1.59) 


SN 


which is an illustration of the chain rule of differentiation. 

(3) The Gibbs phase rule. In constructing a scale for temperature, we 
used the triple point of steam—water-ice in Fig. 1.3 as a reference standard. 
How can we be sure that there is indeed a unique coexistence point, and 
how robust is it? The phase diagram in Fig. 1.3 depicts the states of the 
system in terms of the two intensive parameters P and 7. Quite generally, 
if there are n ways of performing work on a system that can also change 
its internal energy by transformations between c chemical constituents, the 
number of independent intensive parameters is n+ c. Of course, including 
thermal exchanges there are n+ c+ 1 displacement-like variables in Eq. (1.45), 
but the intensive variables are constrained by Eq. (1.49); at least one of the 
parameters characterizing the system must be extensive. The system depicted in 
Fig. 1.3 corresponds to a one-component system (water) with only one means 
of doing work (hydrostatic), and is thus described by two independent intensive 
coordinates, for example, (P, 7) or (uw, 7). In a situation such as depicted in 
Fig. 1.17, where two phases (liquid and gas) coexist, there is an additional 
constraint on the intensive parameters, as the chemical potentials must be equal 
in the two phases. This constraint reduces the number of independent parameters 
by 1, and the corresponding manifold for coexisting phases in Fig. 1.3 is one- 
dimensional. At the triple point, where three phases coexist, we have to impose 
another constraint so that all three chemical potentials are equal. The Gibbs 
phase rule states that quite generally, if there are p phases in coexistence, the 
dimensionality (number of degrees of freedom) of the corresponding loci in 
the space of intensive parameters is 


f=n+c+l1—p. (1.60) 


The triple point of pure water thus occurs at a single point (f = 1+ 1+1—3=0) 
in the space of intensive parameters. If there are additional constituents, for 
example, a concentration of salt in the solution, the number of intensive quan- 
tities increases and the triple point can drift along a corresponding manifold. 


1.9 Stability conditions 


As noted earlier, the conditions derived in Section 1.7 are similar to the well- 
known requirements for mechanical stability: a particle moving freely in an 


1.9 Stability conditions 


unstable 


metastable So 7 


external potential U(x) dissipates energy and settles to equilibrium at a min- 
imum value of U. The vanishing of the force J, = —dU/dx is not by itself 
sufficient to ensure stability, as we must check that it occurs at a minimum 
of the potential energy, such that d?U/dx? > 0. In the presence of an exter- 
nal force J, we must minimize the “enthalpy” H = U — Jx, which amounts 
to tilting the potential. At the new equilibrium point x,,(J), we must require 
d?H/dx? = d?U/dx? > 0. Thus only the convex portions of the potential U(x) 
are physically accessible. 

With more than one mechanical coordinate, the requirement that any change 
6x results in an increase in energy (or enthalpy) can be written as 

2, 
Yaa > 0. (1.61) 

We can express the above equation in more symmetric form, by noting that 
the corresponding change in forces is given by 


1,=0(2) aye. (1.62) 


Ox, ~ OXx;,OX, 
Jj aie, 


i 


Thus Eq. (1.61) is equivalent to 


> 6/,8x; > 0. (1.63) 


When dealing with a thermodynamic system, we should allow for thermal and 
chemical inputs to the internal energy of the system. Including the correspond- 
ing pairs of conjugate coordinates, the condition for mechanical stability should 
generalize to 


5T6S + )° b5,6x; + ¥> bu, 6Ny > 0. (1.64) 


Before examining the consequences of the above condition, I shall provide a 
more standard derivation that is based on the uniformity of an extended thermo- 
dynamic body. Consider a homogeneous system at equilibrium, characterized 
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Fig. 1.19 Possible types 
of mechanical 
equilibrium for a particle 
in a potential. The convex 
portions (solid line) of the 
potential can be explored 
with a finite force J, while 
the concave (dashed line) 
portion around the 
unstable point is not 
accessible. 
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Fig. 1.20 Spontaneous 
change between two 
halves of a homogeneous 
system. 


Thermodynamics 


by intensive state functions (T, J, #4), and extensive variables (E, x, N). Now 
imagine that the system is arbitrarily divided into two equal parts, and that 
one part spontaneously transfers some energy to the other part in the form of 
work or heat. The two subsystems, A and B, initially have the same values for 
the intensive variables, while their extensive coordinates satisfy E, + FE, = E, 
X, +X, =x, and N,+N,=N. After the exchange of energy between the two 
subsystems, the coordinates of A change to 


(E,+6E, x,+6x, N,+6N) and (T,+67,, J,+6J,, wy +6u,), (1.65) 
and those of B to 


(Ey —8E, Xz —8x, Ng—8N) and (T,+5T,, Jp+5Ig, pt Sug). (1.66) 


Note that the overall system is maintained at constant E, x, and N. Since the 
intensive variables are themselves functions of the extensive coordinates, to 
first order in the variations of (E,x, N), we have 


67, =-6T,=67T, 6J,=-6),;=5), du, = dp, = 5p. (1.67) 


Using Eq. (1.48), the entropy of the system can be written as 


Since, by assumption, we are expanding about the equilibrium point, the first- 
order changes vanish, and to second order 


1 J 
85 = 85, +85, =2[3( 7) 0E, 5(F) ax, 5(S*) an, (1.69) 


A A A 


(We have used Eq. (1.67) to note that the second-order contribution of B is the 
same as A.) Equation (1.69) can be rearranged to 


2 lar, (= — Jy: OX, — by ON 
Ty Ty 


) + 8J,-x, +504: ON, | 
(1.70) 


2 
= 7, [67,6S,+6J,- 6x, +64 -ON,] - 
A 


1.9 Stability conditions 


The condition for stable equilibrium is that any change should lead to a decrease 
in entropy, and hence we must have 


5TSS + SJ -5x+5u- SN > 0. (1.71) 


We have now removed the subscript A, as Eq. (1.71) must apply to the whole 
system as well as to any part of it. 

The above condition was obtained assuming that the overall system is kept 
at constant F, x, and N. In fact, since all coordinates appear symmetrically in 
this expression, the same result is obtained for any other set of constraints. For 
example, variations in 6T and 6x with 6N = 0, lead to 


0 0 

[ 6S = a 6T + a) 8x; 
aT |. ax; | 

(1.72) 
au, au, 

pS) or) Be 
l yg ee a 
Substituting these variations into Eq. (1.71) leads to 

os | OJ; | 

—| (6T)’+ —}| 4x,6x, > 0. 173 

ar.‘ ) si ax; |, xjOX; = ( ) 


Note that the cross terms proportional to 676x,; cancel due to the Maxwell 
relation in Eq. (1.56). Equation (1.73) is a quadratic form, and must be positive 
for all choices of 6T and 5x. The resulting constraints on the coefficients are 
independent of how the system was initially partitioned into subsystems A and 
B, and represent the conditions for stable equilibrium. If only 67 is non-zero, 
Eq. (1.71) requires 0S/0T|, > 0, implying a positive heat capacity, since 


=T —| >0. (1.74) 


If only one of the 6x; in Eq. (1.71) is non-zero, the corresponding response 
function 0x;/ Fil p x, must be positive. However, a more general requirement 
exists since all 6x values may be chosen non-zero. The general requirement is 
that the matrix of coefficients dJ;/ ax;|. 
positive definite if all of its eigenvalues are positive. It is necessary, but not 


must be positive definite. A matrix is 


sufficient, that all the diagonal elements of such a matrix (the inverse response 
functions) be positive, leading to further constraints between the response 
functions. Including chemical work for a gas, the appropriate matrix is 


oP oP 
av T,N aN TV 
a ai (1.75) 
av T,N aN TV 
In addition to the positivity of the response functions K;y = —V~! dV/ OP | py 


and dN/du|,.y, the determinant of the matrix must be positive, requiring 


oP 
ON 


oP 
OV 


Of 
T,N aN T,V 


Of 


>0. (1.76) 
OV 


T,N 
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Fig. 1.21 Stability 
condition at criticality, 
illustrated for van der 
Waals isotherms. 
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Another interesting consequence of Eq. (1.71) pertains to the critical point 
of a gas where 0P/ OV, vy = 0. Assuming that the critical isotherm can be 
analytically expanded as 
1 #P 
2 aw? 


, 1 8P 


8V+ oe 
caer 


T..N 


oP 
5P(T =T.) = a 6Ve4+e.-, (1.77) 


Te,N 


the stability condition —8P6V > 0 implies that 4? P/dV? 
the third derivative negative, if the first derivative vanishes. This condition is 


ry Must be zero, and 


used to obtain the critical point of the gas from approximations to the isotherms 
(as we shall do in a later chapter for the van der Waals equation). In fact, it is 
usually not justified to make a Taylor expansion around the critical point as in 
Eq. (1.77), although the constraint —6P5V > 0 remains applicable. 


pressure P 


specific volume v 


1.10 The third law 


Differences in entropy between two states can be computed using the 
second law, from AS = / dQ,.,/T. Low-temperature experiments indicate that 
AS(X, T) vanishes as T goes to zero for any set of coordinates X. This obser- 
vation is independent of the other laws of thermodynamics, leading to the 
formulation of a third law by Nernst, which states: 


The entropy of all systems at zero absolute temperature is a universal constant 
that can be taken to be zero. 


The above statement actually implies that 
lim S(X, T) = 0, (1.78) 


which is a stronger requirement than the vanishing of the differences AS(X, T). 
This extended condition has been tested for metastable phases of a substance. 
Certain materials, such as sulfur or phosphine, can exist in a number of rather 
similar crystalline structures (allotropes). Of course, at a given temperature 


1.10 The third law 


only one of these structures is truly stable. Let us imagine that, as the high- 
temperature equilibrium phase A is cooled slowly, it makes a transition at a 
temperature T* to phase B, releasing latent heat L. Under more rapid cooling 
conditions the transition is avoided, and phase A persists in metastable equilib- 
rium. The entropies in the two phases can be calculated by measuring the heat 
capacities C,(T) and C,(T). Starting from T = 0, the entropy at a temperature 


slightly above T* can be computed along the two possible paths as 


C,(T") 
T’ 


CAT). 2 
T' 


yb Hh 
tT +) = 5,(0)+ | dT’ = 5,(0)+ [ dT’ 


By such measurements we can indeed verify that $,(0) = S,(0) = 0. 


A 


metastable A a (e heat L 
ra a 


Consequences of the third law: 


1. Since S(T = 0, X) = 0 for all coordinates X, 


2. Heat capacities must vanish as T —> 0 since 
r Cy(T’ 
S(T, X) — S(O, X) = | ar A) 
0 dtd 
and the integral diverges as T —> 0 unless 


lim Cx(T) = 0. 


3. Thermal expansivities also vanish as T — 0 since 
1 ox | 1 as| 
a,=—- | =- sl 
x OT|, x OJ, 


+ 


(1.79) 
Fig. 1.22 Heat capacity 
measurements on 
allotropes of the same 
material. 

(1.80) 

(1.81) 

(1.82) 

(1.83) 


The second equality follows from the Maxwell relation in Eq. (1.56). The vanishing of 


the latter is guaranteed by Eq. (1.80). 
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Fig. 1.23 An infinite 
number of steps is 
required to cool a gas to 
T =0 by a series of 
isothermal 
decompressions. 
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4. It is impossible to cool any system to absolute zero temperature in a finite number of steps. 
For example, we can cool a gas by an adiabatic reduction in pressure. Since the curves of 
S versus T for different pressures must join at T = 0, successive steps involve progressively 
smaller changes, in S and in 7, on approaching zero temperature. Alternatively, the 
unattainability of zero temperatures implies that S(T =0, P) is independent of P. This is 
a weaker statement of the third law, which also implies the equality of zero temperature 
entropy for different substances. 


In the following chapters, we shall attempt to justify the laws of thermody- 
namics from a microscopic point of view. The first law is clearly a reflection 
of the conservation of energy, which also operates at the microscopic level. 
The zeroth and second laws suggest an irreversible approach to equilibrium, 
a concept that has no analog at the particulate level. It is justified as reflecting 
the collective tendencies of large numbers of degrees of freedom. In statistical 
mechanics the entropy per particle is calculated as S/N = kz In(gy)/N, where 
gy is the degeneracy of the states (number of configurations with the same 
energy) of a system of N particles. The third law of thermodynamics thus 
requires that limy_,,, In(gy)/N — 0 at T =0, limiting the possible number of 
ground states for a many-body system. 

The above condition does not hold within the framework of classical sta- 
tistical mechanics, as there are examples of both non-interacting (such as an 
ideal gas) and interacting (the frustrated spins in a triangular antiferromagnet) 
systems with a large number of (degenerate) ground states, and a finite zero- 
temperature entropy. However, classical mechanics is inapplicable at very low 
temperatures and energies where quantum effects become important. The third 
law is then equivalent to a restriction on the degeneracy of ground states of a 
quantum mechanical system.* While this can be proved for a non-interacting 


3 For any spin system with rotational symmetry, such as a ferromagnet, there are of course many 
possible ground states related by rotations. However, the number of such states does not grow 
with the number of spins N, thus such degeneracy does not affect the absence of a 
thermodynamic entropy at zero temperature. 


Problems 


system of identical particles (as we shall demonstrate in the final chapter), there 
is no general proof of its validity with interactions. Unfortunately, the onset of 
quantum effects (and other possible origins of the breaking of classical degen- 
eracy) is system-specific. Hence it is not a priori clear how low the temperature 
must be before the predictions of the third law can be observed. Another defi- 
ciency of the law is its inapplicability to glassy phases. Glasses result from 
the freezing of supercooled liquids into configurations with extremely slow 
dynamics. While not truly equilibrium phases (and hence subject to all the 
laws of thermodynamics), they are effectively so due to the slowness of the 
dynamics. A possible test of the applicability of the third law to glasses is 
discussed in the problems. 


Problems for chapter 1 


1. Surface tension: thermodynamic properties of the interface between two phases are 
described by a state function called the surface tension S. It is defined in terms of the 
work required to increase the surface area by an amount dA through dW = SdA. 


(a) By considering the work done against surface tension in an infinitesimal change in 
radius, show that the pressure inside a spherical drop of water of radius R is larger 
than outside pressure by 25/R. What is the air pressure inside a soap bubble of 


radius R? 
(b) A water droplet condenses on a solid surface. There are three surface tensions 
involved, S,,,,, 5,,, and S,,, where a, s, and w refer to air, solid, and water, respec- 


tively. Calculate the angle of contact, and find the condition for the appearance of a 
water film (complete wetting). 

(c) In the realm of “large” bodies gravity is the dominant force, while at “small” distances 
surface tension effects are all important. At room temperature, the surface tension 
of water is S, * 7x 10-?N m“’. Estimate the typical length scale that separates 
“large” and “small” behaviors. Give a couple of examples for where this length scale 
is important. 


2K ok Kok KK 


2. Surfactants: surfactant molecules such as those in soap or shampoo prefer to spread on 
the air—water surface rather than dissolve in water. To see this, float a hair on the surface 
of water and gently touch the water in its vicinity with a piece of soap. (This is also why 
a piece of soap can power a toy paper boat.) 


(a) The air—water surface tension S, (assumed to be temperature-independent) is reduced 
roughly by N k,7/A, where N is the number of surfactant particles, and A is the 
area. Explain this result qualitatively. 

(b) Place a drop of water on a clean surface. Observe what happens to the air—water 
surface contact angle as you gently touch the droplet surface with a small piece of 
soap, and explain the observation. 
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(c) More careful observations show that at higher surfactant densities 


> 


as | Nk,T 2a (N\? aT | A—Nb 
= B , and 


dA|, (A—Nb? AN\A a8|,  Nkz 


where a and b are constants. Obtain the expression for S(A, T) and explain qualita- 


tively the origin of the corrections described by a and b. 
aE 


oe | = 0s 
0A IT 0A 8 


° 0A 


: ; 4 ar 
(d) Find an expression for Cs; — C, in terms of N 7p and 3] ,- 
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. Temperature scales: prove the equivalence of the ideal gas temperature scale ©, and the 


thermodynamic scale T, by performing a Carnot cycle on an ideal gas. The ideal gas 
satisfies PV = N k,®, and its internal energy E is a function of © only. However, you 


may not assume that E x ®. You may wish to proceed as follows: 


(a) Calculate the heat exchanges Q,, and Q; as a function of ©,, O,, and the volume 
expansion factors. 

(b) Calculate the volume expansion factor in an adiabatic process as a function of ©. 

(c) Show that O,,/Q¢ = @y/Oc. 


2K Kok ok kK 


. Equations of state: the equation of state constrains the form of internal energy as in the 


following examples. 


(a) Starting from dE = TdS — PdV, show that the equation of state PV = Nk,T in fact 
implies that E can only depend on T. 

(b) What is the most general equation of state consistent with an internal energy that 
depends only on temperature? 


(c) Show that for a van der Waals gas Cy, is a function of temperature alone. 


2K ok ok ok kK 


. The Clausius—Clapeyron equation describes the variation of boiling point with pressure. 


It is usually derived from the condition that the chemical potentials of the gas and liquid 
phases are the same at coexistence. For an alternative derivation, consider a Carnot 
engine using one mole of water. At the source (P, 7) the latent heat L is supplied 
converting water to steam. There is a volume increase V associated with this process. 
The pressure is adiabatically decreased to P—dP. At the sink (P—dP, T—dT) steam 
is condensed back to water. 


(a) Show that the work output of the engine is W = VdP+ O(dP?). Hence obtain the 


Clausius—Clapeyron equation 


dP L 


aT = TV" () 


boiling 


(b) 


(c) 


(d) 


(e) 


(f) 


Problems 


What is wrong with the following argument: “The heat Q,, supplied at the source to 
convert one mole of water to steam is L(T). At the sink L(T —dT) is supplied to 
condense one mole of steam to water. The difference dTdL/dT must equal the work 
W = VdP, equal to LdT/T from Eq. (1). Hence dL/dT = L/T, implying that L is 
proportional to T!” 

Assume that L is approximately temperature-independent, and that the volume change 
is dominated by the volume of steam treated as an ideal gas, that is, V = Nk,T/P. 
Integrate Eq. (1) to obtain P(T). 

A hurricane works somewhat like the engine described above. Water evaporates 
at the warm surface of the ocean, steam rises up in the atmosphere, and con- 
denses to water at the higher and cooler altitudes. The Coriolis force converts 
the upward suction of the air to spiral motion. (Using ice and boiling water, 
you can create a little storm in a tea cup.) Typical values of warm ocean sur- 
face and high altitude temperatures are 80°F and —120°F, respectively. The warm 
water surface layer must be at least 200 feet thick to provide sufficient water 
vapor, as the hurricane needs to condense about 90 million tons of water vapor 
per hour to maintain itself. Estimate the maximum possible efficiency, and power 
output, of such a hurricane. (The latent heat of vaporization of water is about 
2.3 x 10°J kg.) 

Due to gravity, atmospheric pressure P(h) drops with the height 4. By balancing the 
forces acting on a slab of air (behaving like a perfect gas) of thickness dh, show that 
P(h) = P) exp(—mgh/kT), where m is the average mass of a molecule in air. 

Use the above results to estimate the boiling temperature of water on top of 
Mount Everest (h © 9km). The latent heat of vaporization of water is about 
2.3x 10°F kg. 
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6. Glass: liquid quartz, if cooled slowly, crystallizes at a temperature T,,,, and releases latent 


m? 


heat L. Under more rapid cooling conditions, the liquid is supercooled and becomes 


glassy. 


(a) 


(b) 


(c) 


(d) 


(e) 


As both phases of quartz are almost incompressible, there is no work input, and 
changes in internal energy satisfy dE = TdS+ dN. Use the extensivity condition 
to obtain the expression for yz in terms of E, T, S, and N. 

The heat capacity of crystalline quartz is approximately Cy = aT?, while that of 
glassy quartz is roughly Cg = BT, where a and P are constants. 

Assuming that the third law of thermodynamics applies to both crystalline and glass 
phases, calculate the entropies of the two phases at temperatures T < T,,. 
At zero temperature the local bonding structure is similar in glass and 
crystalline quartz, so that they have approximately the same _ internal 
energy Ey. Calculate the internal energies of both phases at temperatures 
T <T,,. 

Use the condition of thermal equilibrium between two phases to compute the equi- 
librium melting temperature T,, in terms of a and B. 


Compute the latent heat L in terms of @ and B. 
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(f) Is the result in the previous part correct? If not, which of the steps leading to it is 
most likely to be incorrect? 


2K 2k ok ok kK 


7. Filament: for an elastic filament it is found that, at a finite range in temperature, a 


displacement x requires a force 
J=ax—bT+cTx, 


where a, b, and c are constants. Furthermore, its heat capacity at constant displacement 
is proportional to temperature, that is, C, = A(x)T. 


(a) Use an appropriate Maxwell relation to calculate 0S/0x|,. 

(b) Show that A has to in fact be independent of x, that is, dA/dx = 0. 

(c) Give the expression for S(T, x) assuming S(0, 0) = So. 

(d) Calculate the heat capacity at constant tension, that is, C; = T 0S/dT|, as a function 
of T and J. 
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8. Hard core gas: a gas obeys the equation of state P(V — Nb) = Nk,T, and has a heat 
capacity Cy independent of temperature. (N is kept fixed in the following.) 


(a) Find the Maxwell relation involving 0S/dV|, y- 

(b) By calculating dE(T, V), show that E is a function of T (and N) only. 

(c) Show that y = Cp/Cy = 1+ Nk,/Cy (independent of T and V). 

(d) By writing an expression for E(P, V), or otherwise, show that an adiabatic change 
satisfies the equation P(V — Nb)’ = constant. 
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9. Superconducting transition: many metals become superconductors at low temperatures 
T, and magnetic fields B. The heat capacities of the two phases at zero magnetic field 


are approximately given by 


| C,(T) = VaT? in the superconducting phase 


’ 


(O.() =V [BT? + yT] in the normal phase 


where V is the volume, and {a@, B, y} are constants. (There is no appreciable change in 
volume at this transition, and mechanical work can be ignored throughout this problem.) 


(a) Calculate the entropies S,(T) and S,,(T) of the two phases at zero field, using the 
third law of thermodynamics. 

(b) Experiments indicate that there is no latent heat (L = 0) for the transition between 
the normal and superconducting phases at zero field. Use this information to obtain 
the transition temperature T., as a function of a, B, and y. 


Problems 


(c) At zero temperature, the electrons in the superconductor form bound Cooper pairs. 
As a result, the internal energy of the superconductor is reduced by an amount 
VA, that is, E,(T = 0) = Ey and E,(T = 0) = E, — VA for the metal and super- 
conductor, respectively. Calculate the internal energies of both phases at finite 
temperatures. 

(d) By comparing the Gibbs free energies (or chemical potentials) in the two phases, 
obtain an expression for the energy gap A in terms of a, B, and y. 

(e) In the presence of a magnetic field B, inclusion of magnetic work results in dE = 
TdS + BdM + wdN, where M is the magnetization. The superconducting phase is 
a perfect diamagnet, expelling the magnetic field from its interior, such that M, = 
—VB/(477) in appropriate units. The normal metal can be regarded as approximately 
non-magnetic, with M, = 0. Use this information, in conjunction with previous 
results, to show that the superconducting phase becomes normal for magnetic fields 


larger than 


2 
BAT) = By (1-7) ’ 


c 


giving an expression for Bo. 
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10. Photon gas Carnot cycle: the aim of this problem is to obtain the black-body radiation 


relation, E(T, V) x VT‘, starting from the equation of state, by performing an infinitesimal 


Carnot cycle on the photon gas. 


(a) Express the work done, W, in the above cycle, in terms of dV and dP. 

(b) Express the heat absorbed, Q, in expanding the gas along an isotherm, in terms of 
P, dV, and an appropriate derivative of E(T, V). 

(c) Using the efficiency of the Carnot cycle, relate the above expressions for W and Q 
to T and dT. 

(d) Observations indicate that the pressure of the photon gas is given by P= AT“, where 
A= 7k, /45 (Ac)° is a constant. Use this information to obtain E(T, V), assuming 
E(0, V) =0. 

(e) Find the relation describing the adiabatic paths in the above cycle. 
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11. Irreversible processes 


(a) 


(b) 


Consider two substances, initially at temperatures 7? and T}, coming to equilibrium 
at a final temperature T, through heat exchange. By relating the direction of heat 
flow to the temperature difference, show that the change in the total entropy, which 


can be written as 


Ty 4 ty 4 T=T 
AS=AS,+A5,> | Gy f G2 _ Lap: 
T. 


rT 9 T, T,T, 


2 


must be positive. This is an example of the more general condition that “in a closed 
system, equilibrium is characterized by the maximum value of entropy S.” 
Now consider a gas with adjustable volume V, and diathermal walls, embedded in a 
heat bath of constant temperature T, and fixed pressure P. The change in the entropy 
of the bath is given by 

— AQpatn AQ pas 


1 
AS path rl T = T = T (AE gas ae PAV gas) 3 


By considering the change in entropy of the combined system establish that “the 
equilibrium of a gas at fixed T and P is characterized by the minimum of the Gibbs 
free energy G=E+PV—TS.” 
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12. The Solar System originated from a dilute gas of particles, sufficiently separated from 


other such clouds to be regarded as an isolated system. Under the action of gravity the 


particles coalesced to form the Sun and planets. 


(a) 


(b) 


(c) 


The motion and organization of planets is much more ordered than the original dust 
cloud. Why does this not violate the second law of thermodynamics? 

The nuclear processes of the Sun convert protons to heavier elements such as carbon. 
Does this further organization lead to a reduction in entropy? 

The evolution of life and intelligence requires even further levels of organization. 
How is this achieved on Earth without violating the second law? 
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2 
Probability 


2.1 General definitions 


The laws of thermodynamics are based on observations of macroscopic bodies, 
and encapsulate their thermal properties. On the other hand, matter is composed 
of atoms and molecules whose motions are governed by more fundamental 
laws (classical or quantum mechanics). It should be possible, in principle, to 
derive the behavior of a macroscopic body from the knowledge of its com- 
ponents. This is the problem addressed by kinetic theory in the following 
chapter. Actually, describing the full dynamics of the enormous number of 
particles involved is quite a daunting task. As we shall demonstrate, for dis- 
cussing equilibrium properties of a macroscopic system, full knowledge of the 
behavior of its constituent particles is not necessary. All that is required is 
the likelihood that the particles are in a particular microscopic state. Statistical 
mechanics is thus an inherently probabilistic description of the system, and 
familiarity with manipulations of probabilities is an important prerequisite. The 
purpose of this chapter is to review some important results in the theory of 
probability, and to introduce the notations that will be used in the following 
chapters. 

The entity under investigation is a random variable x, which has a set of pos- 
sible outcomes S = {x,, X»,---}. The outcomes may be discrete as in the case of 
a coin toss, S.,i, = {head, tail}, or a dice throw, S,;. = {1, 2,3, 4,5, 6}, or con- 
tinuous as for the velocity of a particle in a gas, 5; = {-00 < Uy, Vy, UZ < oo}, 
or the energy of an electron in a metal at zero temperature, S, = {0 < € <e,}. 
An event is any subset of outcomes E C S, and is assigned a probability p(E), 
for example, Dgice({1}) = 1/6, or Paice ({1, 3}) = 1/3. From an axiomatic point 
of view, the probabilities must satisfy the following conditions: 


(i) Positivity. p(E) = 0, that is, all probabilities must be real and non-negative. 
(ii) Additivity. p(A or B) = p(A)+ p(B), if A and B are disconnected events. 


(iii) Normalization. p(S) = 1, that is, the random variable must have some outcome 
in S. 
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Fig. 2.1 A typical 
cumulative probability 
function. 


Probability 


From a practical point of view, we would like to know how to assign 
probability values to various outcomes. There are two possible approaches: 


1. Objective probabilities are obtained experimentally from the relative frequency of the 
occurrence of an outcome in many tests of the random variable. If the random process is 


repeated N times, and the event A occurs N, times, then 
Na 
A) = lim —. 
PAY Ny 


For example, a series of N = 100, 200, 300 throws of a dice may result in N, = 19, 30, 48 
occurrences of 1. The ratios 0.19, 0.15, 0.16 provide an increasingly more reliable estimate 
of the probability pgi..({1})- 

2. Subjective probabilities provide a theoretical estimate based on the uncertainties related 
to lack of precise knowledge of outcomes. For example, the assessment p,;..({1}) = 1/6 
is based on the knowledge that there are six possible outcomes to a dice throw, and that in 
the absence of any prior reason to believe that the dice is biased, all six are equally likely. 
All assignments of probability in statistical mechanics are subjectively based. The conse- 
quences of such subjective assignments of probability have to be checked against measure- 
ments, and they may need to be modified as more information about the outcomes becomes 


available. 


2.2 One random variable 


As the properties of a discrete random variable are rather well known, here 
we focus on continuous random variables, which are more relevant to our 
purposes. Consider a random variable x, whose outcomes are real numbers, 
that is, S, = {—0o < x < oo}. 


e The cumulative probability function (CPF) P(x) is the probability of an 
outcome with any value less than x, that is, P(x) = prob(E C [—o0, x]). P(x) 
must be a monotonically increasing function of x, with P(—oco) =0 and 
P(+o0) = 1. 


P(x) 


ta 


2.2 One random variable 


The probability density function (PDF) is defined by p(x) = dP(x)/dx. 
Hence, p(x)dx = prob(E € [x, x+dx]). As a probability density, it is positive, 
and normalized such that 


prob($) = [ 7 dx p(x) =1. (2.1) 


Note that since p(x) is a probability density, it has dimensions of [x]~!, and 
changes its value if the units measuring x are modified. Unlike P(x), the PDF 
has no upper bound, that is, 0 < p(x) < oo, and may contain divergences as 
long as they are integrable. 

The expectation value of any function, F(x), of the random variable is 


(FO) = [dx pO)FOX), (2.2) 


The function F(x) is itself a random variable, with an associated PDF of 


pr(f)df = prob(F(x) € [f, f +d/]). There may be multiple solutions x; to the 
equation F(x) = f, and 


Pr(f)df = Dd P(a)dx, , => pr(f)= dP) (2.3) 


dx 
dF 


X=NXj 


The factors of |dx/dF| are the Jacobians associated with the change of variables 
from x to F. For example, consider p(x) = Aexp(—A|x|)/2, and the function 


Fig. 2.2 A typical 
probability density 
function. 


Fig. 2.3 Obtaining the 
PDF for the function 
F(x). 
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F(x) = x’. There are two solutions to F(x) = f, located at x, = +,/f, with 
corresponding Jacobians | -+ f~!/?/2|. Hence, 


1 + -1 ) = Aexp (—A,/f) 
2/f| |2/f 2/f ; 
for f > 0, and p;(f) =0 for f < 0. Note that p,(f) has an (integrable) diver- 
gence at f =0. 


Pr(f)= 4 exp (-AVF) ( 


Fig. 2.4 Probability 
density functions for x, 
and F = x?. 


P Py 


© Moments of the PDF are expectation values for powers of the random vari- 
able. The nth moment is 


m, = (x") = / dxp(x)x". (2.4) 


© The characteristic function is the generator of moments of the distribution. 
It is simply the Fourier transform of the PDF, defined by 


p(k) =(e*) = / dxp(x) e*, (2.5) 


The PDF can be recovered from the characteristic function through the inverse 
Fourier transform 


p(x) = x / dkp(k) et**, (2.6) 


Moments of the distribution are obtained by expanding p(k) in powers of k, 
fed a —ik)" n = —ik)" n 
p= (a) =F SO a, (2.7) 
n=0 Nn. n=0 An, 
Moments of the PDF around any point x, can also be generated by expanding 


elM05() = (e400) = sek ((x—X9)"). (2.8) 


n=0 


2.2 One random variable 


© The cumulant generating function is the logarithm of the characteristic func- 
tion. Its expansion generates the cumulants of the distribution defined through 


inp) = (er, 


n=1 


(2.9) 


Relations between moments and cumulants can be obtained by expanding 
the logarithm of p(k) in Eq. (2.7), and using 


In(i+e)= 


reyes 


n=1 


(2.10) 


The first four cumulants are called the mean, variance, skewness, and curtosis 
(or kurtosis) of the distribution, respectively, and are obtained from the 
moments as 


2.11 
—3(x") (x) +2(x)’, = 


x4) —4(x9) (x) —3 (x2) + 12 (x?) (x)? — 6 (x)*. 
The cumulants provide a useful and compact way of describing a PDF. 


An important theorem allows easy computation of moments in terms of the 
cumulants: represent the nth cumulant graphically as a connected cluster of n 
points. The mth moment is then obtained by summing all possible subdivisions 
of m points into groupings of smaller (connected or disconnected) clusters. The 
contribution of each subdivision to the sum is the product of the connected 
cumulants that it represents. Using this result, the first four moments are 
computed graphically. 


<x>= e 
2 
<x°>= «ee: + eo 
<x >= : ee 
‘Se. oe eo 
<xt>= “Se. +6 ‘6 + ee 


The corresponding algebraic expressions are 
(x) =(X)o» 
(7) =(27) + (aye 
(7) =(27) +3007), C+ Ne» 
(x4) =(x4) +4 (29), (x), +3 (27) + 


(2.12) 


6 (x7). (aye + (x). 


Fig. 2.5 Graphical 
computation of the first 
four moments. 


39 


40 


Probability 


This theorem, which is the starting point for various diagrammatic computations 
in statistical mechanics and field theory, is easily proved by equating the 
expressions in Eqs (2.7) and (2.9) for p(k): 


5 Gy ae oe" (2Y"]. er 
m=0 . n=1 = nN Dn n* = 


Matching the powers of (—ik)” on the two sides of the above expression leads to 


x") = 3 m! Irae GO (2.14) 


Wn! 
{Pn} wa ye 


The sum is restricted such that }° np,, = m, and leads to the graphical interpre- 
tation given above, as the numerical factor is simply the number of ways of 
breaking m points into {p,} clusters of n points. 


2.3 Some important probability distributions 


The properties of three commonly encountered probability distributions are 
examined in this section. 


(1) The normal (Gaussian) distribution describes a continuous real random 
variable x, with 


1 (x— A)? 
= : 21 
px) = en] -P | 2.15) 
The corresponding characteristic function also has a Gaussian form, 
. oe 1 (x-A’? ko? 
P(k) = [. We ia exp | 762 its] = exp [—ika eae ea | (2.16) 


Cumulants of the distribution can be identified from In p(k) = —ikA — k?0?/2, 
using Eq. (2.9), as 


(X= Ny cae =o", (x"} = (x*). =---=0. (2.17) 


The normal distribution is thus completely specified by its two first cumu- 
lants. This makes the computation of moments using the cluster expansion 
(Eqs. (2.12)) particularly simple, and 


(x) =A, 
(x?) =07 +2, 
(x3) =30°A +03, (2.18) 


(x*) =304 + 60°A? +.a%, 


2.3 Some important probability distributions 


The normal distribution serves as the starting point for most perturbative 
computations in field theory. The vanishing of higher cumulants implies that 
all graphical computations involve only products of one-point, and two-point 
(known as propagators), clusters. 

(2) The binomial distribution: consider a random variable with two outcomes 
A and B (e.g., a coin toss) of relative probabilities p, and pz = 1— p,. The 
probability that in N trials the event A occurs exactly N, times (e.g., 5 heads 
in 12 coin tosses) is given by the binomial distribution 


N = 
Py(Nq) = ( eae as (2.19) 
Na 


The prefactor, 


N N! 
i) ~ NING)! “se 


is just the coefficient obtained in the binomial expansion of (p,+p,)”, and 
gives the number of possible orderings of N, events A and Nz = N — N, events 
B. The characteristic function for this discrete distribution is given by 


Ny N! None os N 
p (k) = ekNaA = ye p Ap A ekNa =(p ek +p ; (2.21) 
u ( Pyare) tne) eal (Ps a) 


The resulting cumulant generating function is 
In py(k) = N In (pge“ + pg) = N np, (k), (2.22) 


where In p,(k) is the cumulant generating function for a single trial. Hence, the 
cumulants after N trials are simply N times the cumulants in a single trial. In 
each trial, the allowed values of N, are 0 and | with respective probabilities p, 
and p,, leading to (N. i) = p,, for all £2. After N trials the first two cumulants 
are 


(Nade=NPar (Na). =N (Pa- Pa) = NPaPo- (2.23) 


A measure of fluctuations around the mean is provided by the standard devia- 
tion, which is the square root of the variance. While the mean of the binomial 
distribution scales as N, its standard deviation only grows as VN. Hence, the 
relative uncertainty becomes smaller for large N. 

The binomial distribution is straightforwardly generalized to a multinomial 
distribution, when the several outcomes {A, B,--- , M} occur with probabilities 
{P4>Pp>**+ > Pu}. The probability of finding outcomes {N,, Ng,--- , Ny} ina 
total of N= N,+Ng+---+Ny trials is 


N! 


NRT pit (2.24) 
A+LVB: M: 


Py {Nas Ngee» Nuh) = 
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Fig. 2.6 Subdividing the 
time interval into small 
segments of size dt. 


Probability 


(3) The Poisson distribution: the classical example of a Poisson process 
is radioactive decay. Observing a piece of radioactive material over a time 
interval T shows that: 


(a) The probability of one and only one event (decay) in the interval [t, t+ dr] is proportional 
to dt as dt 0. 


(b) The probabilities of events at different intervals are independent of each other. 


The probability of observing exactly M decays in the interval T is given by 
the Poisson distribution. It is obtained as a limit of the binomial distribution 
by subdividing the interval into N = T/dt > 1 segments of size dt. In each 
segment, an event occurs with probability p = adt, and there is no event with 
probability g = 1 — adt. As the probability of more than one event in dt is too 
small to consider, the process is equivalent to a binomial one. Using Eq. (2.21), 
the characteristic function is given by 


p(k) = (ees + q) = = lim [1 + adt (e ie ij” = exp [a(e™ - 1)T] e (2/25) 


dt0 


The Poisson PDF is obtained from the inverse Fourier transform in Eq. (2.6) 
as 


00 0° 00 M 
P(x) = / - exp [a (e" - 1) T +ikx] = aan | OF is > (aT) iM, (2.26) 


-co 277 -0 27 yop M! 


using the power series for the exponential. The integral over k is 


GE ety = 6(x—M), (2.27) 
27. 
leading to 
M 
Par (X) = ve -ar (a “o d(x— M). (2.28) 
M=0 


This answer clearly realizes that the only possible values of x are integers M. 
The probability of M events is thus p,,;(M) =e-*7 (@T)"/M!. The cumulants 
of the distribution are obtained from the expansion 


a 


In par(k) = aT(e* — 1) = aT 3 


n=l 


(M").=aT. (2.29) 


2.4 Many random variables 


All cumulants have the same value, and the moments are obtained from 
Eqs. (2.12) as 


(M)= (eT), (M?)=(aT)+(aT), (M')= (aT +3(aT?+(aT). (2.30) 


Example. Assuming that stars are randomly distributed in the Galaxy 
(clearly unjustified) with a density n, what is the probability that the nearest 
star is at a distance R? Since the probability of finding a star in a small volume 
dV is ndV, and they are assumed to be independent, the number of stars in a 
volume V is described by a Poisson process as in Eq. (2.28), with a =n. The 
probability p(R) of encountering the first star at a distance R is the product of 
the probabilities p,,,(0) of finding zero stars in the volume V = 477R?/3 around 
the origin, and p,,,,(1) of finding one star in the shell of volume dV = 477R7dR 
at a distance R. Both p,y(0) and p,4y(1) can be calculated from Eq. (2.28), 
and 


p(R)dR = Pry (0) Pnav (1) me tah tices AmR? ndR, 


, Bie ss (2.31) 
= p(R) =47R°nexp (Fe n) F 


2.4 Many random variables 


With more than one random variable, the set of outcomes is an N-dimensional 
space, 5, = {—00 < X1,.X),-++ , Xy < co}. For example, describing the location 
and velocity of a gas particle requires six coordinates. 


e The joint PDF p(x) is the probability density of an outcome in a volume 
element d"x =|], dx, around the point x = {x,, x,,--- , xy}. The joint PDF 
is normalized such that 


px(8) = fa xpx) = 1. (2.32) 


If, and only if, the N random variables are independent, the joint PDF is the 
product of individual PDFs, 


P(x) = IT Di (Xj). (2.33) 


The unconditional PDF describes the behavior of a subset of random vari- 
ables, independent of the values of the others. For example, if we are inter- 
ested only in the location of a gas particle, an unconditional PDF can be 
constructed by integrating over all velocities at a given location, p(x) = 
{ @up(&, v); more generally, 


POs 549) = fT] dx pli. sy), (2.34) 


i=m+1 
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The conditional PDF describes the behavior of a subset of random variables, 
for specified values of the others. For example, the PDF for the velocity of 
a particle at a particular location x, denoted by p(v|x), is proportional to the 
joint PDF p(v|x) = p(x, v)/N. The constant of proportionality, obtained by 
normalizing p(v|x ), is 


N= | Hip, i) =p), (2.35) 
the unconditional PDF for a particle at x. In general, the unconditional PDFs 
are obtained from Bayes’ theorem as 


P(X, °° ,Xy) 


P(Xngie 0 shy). 


(2.36) 


P(X1,°°° Xml Xm cy ,Xy) = 


Note that if the random variables are independent, the unconditional PDF is 
equal to the conditional PDF. 
The expectation value of a function F(x) is obtained as before from 


(F(x) = [ a xp(x) F(X). (2.37) 


The joint characteristic function is obtained from the N-dimensional Fourier 
transformation of the joint PDF, 


p(k) = (o» (- 3 7) : (2.38) 
j=l 


The joint moments and joint cumulants are generated by p(k) and In p(k), 
respectively, as 


ny ng nN\ __ d 7 a be a ae — 
eie-¥=[ aay] lace] Lama] BE-® 


my ne nN\ __ a is q ° or = were = 
(x; KX RY .=[z45| lo! la] In p(k = 0). 
(2.39) 


The previously described graphical relation between joint moments (all 
clusters of labeled points) and joint cumulant (connected clusters) is still 
applicable. For example, from 


<XjX> = oe F cel 
12 dD 
2 
2 2 5) 1 5 
e fe 
<X{%)>= ee Ti grey ate, Fels, 
11 11 12 11 


we obtain 
(X1X2) = (X1) (Xo) + (41 XQ), and 


; . : ; (2.40) 
ade =), Ge +(x), (xq). +2 (xy #2) 6 (Xi), (7 * Xp). . 


2.5 Sums of random variables and the central limit theorem 


The connected correlation (Xq* Xp). is zero if x, and xg are independent 
random variables. 

e The joint Gaussian distribution is the generalization of Eq. (2.15) to N 
random variables, as 


P(x) = : = (ce). (Xn ~ Xn) (Xn _ an) ? (2.41) 


! exp 
Jemraetcy | 2% 
where C is a symmetric matrix, and C™! is its inverse. The simplest way 
to get the normalization factor is to make a linear transformation from the 
variables y; = x, — Aj, using the unitary matrix that diagonalizes C. This 
reduces the normalization to that of the product of N Gaussians whose 
variances are determined by the eigenvalues of C. The product of the 
eigenvalues is the determinant det[C]. (This also indicates that the matrix C 
must be positive definite.) The corresponding joint characteristic function is 
obtained by similar manipulations, and is given by 


1 
p(k) = exp [itn = $Conknke ? (2.42) 


where the summation convention (implicit summation over a repeated index) 
is used. The joint cumulants of the Gaussian are then obtained from In p(k) as 


(Xm) ¢ = din (Xm 7 Xue — Quine (2.43) 


with all higher cumulants equal to zero. In the special case of {A,,} = 0, 
all odd moments of the distribution are zero, while the general rules for 
relating moments to cumulants indicate that any even moment is obtained 
by summing over all ways of grouping the involved random variables into 
pairs, for example, 


(XqXpXeXa) — Cus Cea fF Cee Cha oh Cua Cree (2.44) 
In the context of field theories, this result is referred to as Wick’s theorem. 


2.5 Sums of random variables and the central 
limit theorem 


Consider the sum X = bas x;, Where x; are random variables with a joint PDF 
of p(x). The PDF for X is 


px(a) = f a xp)8(x— Om) = f Th dap Gase xyat arty), 
(2.45) 


and the corresponding characteristic function (using Eq. (2.38)) is given by 


Dy (k) = (oe (-«xs)} = p(ky =ky = = ky =h). (2.46) 


j=l 
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Cumulants of the sum are obtained by expanding In p,(k), 


4 : N (—ik)? N 
In p (ky = ky = +++ = ky =k) = —ik DO (x:,),+ 5 > (*i,%,). 40° , (2.47) 
ij=1 iy sip 
as 
(X). = Di rides (X7) = Do (axe : (2.48) 
i=1 i 


If the random variables are independent, p(x) = J] p;(x;), and py(k) = [1 p,(k), 
the cross cumulants in Eq. (2.48) vanish, and the nth cumulant of X is simply 
the sum of the individual cumulants, (X”), = °%, (x”),. When all the N 
random variables are independently taken from the same distribution p(x), 
this implies (X”). = N (x")., generalizing the result obtained previously for 
the binomial distribution. For large values of N, the average value of the 
sum is proportional to N, while fluctuations around the mean, as measured 
by the standard deviation, grow only as VN. The random variable y = (X — 
N (x),.)/WN has zero mean, and cumulants that scale as (y"). oc N'~"/?. As 
N — o, only the second cumulant survives, and the PDF for y converges to 
the normal distribution, 


in p(y Des N ae) 2 
jim e(y= Ba )- eo ( ey 


(Note that the Gaussian distribution is the only distribution with only first and 
second cumulants.) 

The convergence of the PDF for the sum of many random variables to a 
normal distribution is an essential result in the context of statistical mechanics 
where such sums are frequently encountered. The central limit theorem states a 
more general form of this result: it is not necessary for the random variables to 
be independent, as the condition . -x;,), < O(N”) is sufficient 
for the validity of Eq. (2.49). 

Note that the above discussion implicitly assumes that the cumulants of the 
individual random variables (appearing in Eq. (2.48)) are finite. What happens if 
this is not the case, that is, when the variables are taken from a very wide PDF? 
The sum may still converge to a so-called Levy distribution. Consider a sum 
of N independent, identically distributed random variables, with the mean set 
to zero for convenience. The variance does not exist if the individual PDF falls 
off slowly at large values as p;(x) = p,(x) « 1/|x|!**, with O <a <2. (a>0 
is required to make sure that the distribution is normalizable; while for a > 2 
the variance is finite.) The behavior of p,(x) at large x determines the behavior 
of p,(k) at small k, and simple power counting indicates that the expansion of 
p(k) is singular, starting with |k|“. Based on this argument we conclude that 


Pee (© semen 


In py (k) = N Inp, (k) = M—alk|* + higher order terms]. (2.50) 


2.6 Rules for large numbers 


As before we can define a rescaled variable y = X/N'/“ to get rid of the N 
dependence of the leading term in the above equation, resulting in 


Jim p(k) = —alk|*. (2.51) 


The higher-order terms appearing in Eq. (2.50) scale with negative powers of N 
and vanish as N — oo. The simplest example of a Levy distribution is obtained 
for a = 1, and corresponds to p, = a/[7(y? + a’)]. (This is the Cauchy distri- 
bution discussed in the problems section.) For other values of a the distribution 
does not have a simple closed form, but can be written as the asymptotic series 


nT ) T(+na) a’ (2.52) 


ee n+1.: 
Pa) = = (-Y)"™' sin (ta) ——— 


n=1 J 


Such distributions describe phenomena with large rare events, characterized 
here by a tail that falls off slowly as p, (y > 0) ~ y"!"*. 


2.6 Rules for large numbers 


To describe equilibrium properties of macroscopic bodies, statistical mechanics 
has to deal with the very large number N of microscopic degrees of freedom. 
Actually, taking the thermodynamic limit of N — oo leads to a number of 
simplifications, some of which are described in this section. 

There are typically three types of N dependence encountered in the thermo- 
dynamic limit: 


(a) Intensive quantities, such as temperature 7, and generalized forces, for example, pressure 
P, and magnetic field B, are independent of N, that is, O(N°). 

(b) Extensive quantities, such as energy E, entropy S, and generalized displacements, 
for example, volume V, and magnetization M , are proportional to N, that is, 
O(N’). 

(c) Exponential dependence, that is, O(exp(No)), is encountered in enumerating discrete 
micro-states, or computing available volumes in phase space. 


Other asymptotic dependencies are certainly not ruled out a priori. For exam- 
ple, the Coulomb energy of N ions at fixed density scales as Q?/R ~~ N°”. 
Such dependencies are rarely encountered in everyday physics. The Coulomb 
interaction of ions is quickly screened by counter-ions, resulting in an exten- 
sive overall energy. (This is not the case in astrophysical problems since the 
gravitational energy is not screened. For example, the entropy of a black hole 
is proportional to the square of its mass.) 
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In statistical mechanics we frequently encounter sums or integrals of expo- 
nential variables. Performing such sums in the thermodynamic limit is consid- 
erably simplified due to the following results. 

(1) Summation of exponential quantities: consider the sum 


N 
§=\E, (2.53) 
i=1 
where each term is positive, with an exponential dependence on N, that is, 


0<é,~ O(exp(N¢;)), (2.54) 


and the number of terms WV is proportional to some power of N. 


Fig. 2.7 A sum over NV E 
exponentially large 
quantities is dominated 
by the largest term. 


Such a sum can be approximated by its largest term & 
sense. Since for each term in the sum, 0< €; < € 


in the following 


max? 


Emax < 8 < NEmax: (2.55) 


An intensive quantity can be constructed from In S/N, which is bounded by 


In€yax . nS — Iné,,, Inn 
< < 


a ee — (2.56) 
For NV «x N?, the ratio In V/N vanishes in the large N limit, and 
Ins In€,, 
lim — = a = bx: 2.57 
(2) Saddle point integration: similarly, an integral of the form 
eS / dxexp (NO(x)) (2.58) 


can be approximated by the maximum value of the integrand, obtained at a 
point x,,,, that maximizes the exponent (x). Expanding the exponent around 
this point gives 


= [ axexp{] ba) 316ml am? + |b 259) 


2.6 Rules for large numbers 


Note that at the maximum, the first derivative f’(x,,,) is zero, while the second 
derivative $’ (Xx) 1s negative. Terminating the series at the quadratic order 
results in 


Xx, N w” 27 Xx, 
xen) f dex | 218") —Aima)?| © ga 2.60 


where the range of integration has been extended to [—oo, co]. The latter 
is justified since the integrand is negligibly small outside the neighborhood 
Of Xmax- 


r eVow 


There are two types of correction to the above result. Firstly, there are 
higher-order terms in the expansion of @(x) around x,,,,. These corrections can 


be looked at perturbatively, and lead to a series in powers of 1/N. Secondly, 


/ 
max 


leads to a similar Gaussian integral that can be added to Eq. (2.60). Clearly 
such contributions are smaller by O(exp{—N[@(Xnax) — P(X sax) }})- Since all 
these corrections vanish in the thermodynamic limit, 


InJ 1 (NID (Xn 1 
ig = iin co Ms in( ooewll) L0()| = (Xmax)- (2.61) 


there may be additional local maxima for the function. A maximum at x 


The saddle point method for evaluating integrals is the extension of the above 
result to more general integrands, and integration paths in the complex plane. 
(The appropriate extremum in the complex plane is a saddle point.) The sim- 
plified version presented above is sufficient for our needs. 

Stirling’s approximation for N! at large N can be obtained by saddle point 
integration. In order to get an integral representation of N!, start with the result 


cS 1 
f dxe®* = =, (2.62) 
0 Qa 


Repeated differentiation of both sides of the above equation with respect to a 
leads to 


o N! 
| dxx%e-™ = (2.63) 
0 


aNtl 


Fig. 2.8 Saddle point 
evaluation of an 
“exponential” integral. 
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Although the above derivation only applies to integer N, it is possible to define 
by analytical continuation a function 


I(N+1)=M= / dxxNe-*, (2.64) 
0 


for all NV. While the integral in Eq. (2.64) is not exactly in the form of Eq. (2.58), 
it can still be evaluated by a similar method. The integrand can be written 
as exp (No(x)), with $(x) = Inx—x/N. The exponent has a maximum at 
Xmax = N, with b(%max) = InN —1, and $"(x ax.) = —1/N?. Expanding the 
integrand in Eq. (2.64) around this point yields 


1 
Mx / dxexp [w InN~N~(x— »?] ~ Ne /2aN, (2.65) 


where the integral is evaluated by extending its limits to [—oo, oo]. Stirling’s 
formula is obtained by taking the logarithm of Eq. (2.65) as 


1 1 
InN!= NInN-N+5In2an)+0(). (2.66) 


2.7 Information, entropy, and estimation 


Information: consider a random variable with a discrete set of outcomes S = 
{x;}, occurring with probabilities {p(i)}, for i= 1,--- ,M. In the context of 
information theory there is a precise meaning to the information content of 
a probability distribution. Let us construct a message from N independent 
outcomes of the random variable. Since there are M possibilities for each 
character in this message, it has an apparent information content of N In, M 
bits; that is, this many binary bits of information have to be transmitted to 
convey the message precisely. On the other hand, the probabilities {p(i)} limit 
the types of messages that are likely. For example, if p, >> p,, it is very unlikely 
to construct a message with more x, than x,. In particular, in the limit of 
large N, we expect the message to contain “roughly” {N, = Np;} occurrences 
of each symbol.! The number of typical messages thus corresponds to the 
number of ways of rearranging the {N,} occurrences of {x;}, and is given by 
the multinomial coefficient 
N! 


eae (2.67) 


&§ 
This is much smaller than the total number of messages M”. To specify one 
out of g possible sequences requires 

M 


In, g¥—N>- pny p; (for N > o) (2.68) 


i=1 


' More precisely, the probability of finding any N, that is different from Np; by more than 
O(/N) becomes exponentially small in N, as N > oo. 


2.7 Information, entropy, and estimation 


bits of information. The last result is obtained by applying Stirling’s approxi- 
mation for In N!. It can also be obtained by noting that 


nN M ON M 
l= (=», => MI] Peas elle”. (2.69) 
i (Nj) isl “XI i=l 

where the sum has been replaced by its largest term, as justified in the previous 
section. 

Shannon’s theorem proves more rigorously that the minimum number of 
bits necessary to ensure that the percentage of errors in N trials vanishes in the 
N — oo limit is In, g. For any non-uniform distribution, this is less than the 
N In, M bits needed in the absence of any information on relative probabilities. 
The difference per trial is thus attributed to the information content of the 
probability distribution, and is given by 


M 
T{{p;}] =Ing M+ 7 Ing pj. (2.70) 
i=1 
Entropy: Eq. (2.67) is encountered frequently in statistical mechanics in 
the context of mixing M distinct components; its natural logarithm is related 
to the entropy of mixing. More generally, we can define an entropy for any 
probability distribution as 


M 
—)'p(i) In p(i) = — (In p(d)). (2.71) 
i=1 
The above entropy takes a minimum value of zero for the delta function distri- 
bution p(i) = 6; ;, and a maximum value of In M for the uniform distribution 
p(i) = 1/M. S is thus a measure of dispersity (disorder) of the distribution, and 
does not depend on the values of the random variables {x,;}. A one-to-one map- 
ping to f; = F(x;) leaves the entropy unchanged, while a many-to-one mapping 
makes the distribution more ordered and decreases S. For example, if the two 
values, x, and x,, are mapped onto the same f, the change in entropy is 


AS(x,,%, > f)= [pin dps in <0. (2.72) 
D1 + Pr Pit Po 

Estimation: the entropy S can also be used to quantify subjective estimates 
of probabilities. In the absence of any information, the best unbiased estimate 
is that all M outcomes are equally likely. This is the distribution of maxi- 
mum entropy. If additional information is available, the unbiased estimate is 
obtained by maximizing the entropy subject to the constraints imposed by this 

information. For example, if it is known that (F(x)) = f, we can maximize 


S(a,B,{p:))=- pnp) a (E00 - ) —B (Epcre) -1) , 2.73) 
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where the Lagrange multipliers a and £6 are introduced to impose the constraints 
of normalization, and (F(x)) = f, respectively. The result of the optimization 
is a distribution p; « exp (— BF(x;)), where the value of f is fixed by the 
constraint. This process can be generalized to an arbitrary number of conditions. 
It is easy to see that if the first n = 2k moments (and hence n cumulants) 
of a distribution are specified, the unbiased estimate is the exponential of an 
nth-order polynomial. 

In analogy with Eq. (2.71), we can define an entropy for a continuous 
random variable (S, = {—oo < x < oo}) as 


a / dx p(x) Inp(x) = — (In p(x)) . (2.74) 


There are, however, problems with this definition, as for example S is not 
invariant under a one-to-one mapping. (After a change of variable to f = F(x), 
the entropy is changed by (|F’(x)|).) As discussed in the following chapter, 
canonically conjugate pairs offer a suitable choice of coordinates in classical 
statistical mechanics, since the Jacobian of a canonical transformation is unity. 
The ambiguities are also removed if the continuous variable is discretized. This 
happens quite naturally in quantum statistical mechanics where it is usually 
possible to work with a discrete ladder of states. The appropriate volume for 
discretization of phase space is then set by Planck’s constant A. 


Problems for chapter 2 


1. Characteristic functions: calculate the characteristic function, the mean, and the variance 
of the following probability density functions: 


(a) Uniform p(x) = x for -a<x<a,and p(x)=0 __ otherwise. 
(b) Laplace p(x)= x exp (- i), 
(c) Cauchy p(x) = aera: 
The following two probability density functions are defined for x > 0. Compute 
only the mean and variance for each. 
(d) Rayleigh p(x) = 4 exp(— aN 
(e) Maxwell p(x) = nee exp(— *). 


2K ok ok kk aK 


2. Directed random walk: the motion of a particle in three dimensions is a series of 
independent steps of length ¢. Each step makes an angle 6 with the z axis, with a 
probability density p(@) = 2cos?(@/2)/7; while the angle @ is uniformly distributed 
between 0 and 277. (Note that the solid angle factor of sin @ is already included in the 
definition of p(6), which is correctly normalized to unity.) The particle (walker) starts 
at the origin and makes a large number of steps NV. 


(a) Calculate the expectation values (z), (x), (y), (2°), (x), and (x), and the covariances 
(xy), (xz), and (yz). 


Problems 


(b) Use the central limit theorem to estimate the probability density p(x, y, z) for the 
particle to end up at the point (x, y, z). 


2k ok 2K Kok aK RK 


. Tchebycheff inequality: consider any probability density p(x) for (—co < x < oo), with 
mean A, and variance o*. Show that the total probability of outcomes that are more than 


no away from A is less than 1/n?, that is, 


1 
i, eno 
|jx-A|=no n 


Hint. Start with the integral defining o’, and break it up into parts corresponding to 
|x—A| > no, and |x—A| <no. 


2K KKK KK 


. Optimal selection: in many specialized populations, there is little variability among the 
members. Is this a natural consequence of optimal selection? 


(a) Let {r,} be n random numbers, each independently chosen from a probability density 
p(r), with r € [0, 1]. Calculate the probability density p,,(x) for the largest value of 
this set, that is, for x = max{r,,--- ,7,}. 

(b) If each r, is uniformly distributed between 0 and 1, calculate the mean and variance 
of x as a function of n, and comment on their behavior at large n. 


2k 2K Kok a ok 


. Benford’s law describes the observed probabilities of the first digit in a great variety of 
data sets, such as stock prices. Rather counter-intuitively, the digits 1 through 9 occur with 
probabilities 0.301, 0.176, 0.125, 0.097, 0.079, 0.067, 0.058, 0.051, 0.046, respectively. The 
key observation is that this distribution is invariant under a change of scale, for example, 
if the stock prices were converted from dollars to Persian rials! Find a formula that fits the 
above probabilities on the basis of this observation. 


2k kK ook ok 


. Information: consider the velocity of a gas particle in one dimension (—oo < v < 00). 


(a) Find the unbiased probability density p,(v), subject only to the constraint that the 
average speed is c, that is, {|v|) =c. 

(b) Now find the probability density p,(v), given only the constraint of average kinetic 
energy, (mv? /2) = mc? /2. 

(c) Which of the above statements provides more information on the velocity? Quantify 
the difference in information in terms of J, — J, = ((Inp,) — (In p,)) /1n2. 


2k 2K ook ok 
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7. Dice: a dice is loaded such that 6 occurs twice as often as 1. 


(a) Calculate the unbiased probabilities for the six faces of the dice. 


(b) What is the information content (in bits) of the above statement regarding the dice? 


2K 2k ok ok kK 


8. Random matrices: as a model for energy levels of complex nuclei, Wigner considered 
N x N symmetric matrices whose elements are random. Let us assume that each element 
M,; (for i> j) is an independent random variable taken from the probability density 


function 


1 ‘ 
P(M,;;) = oe for —a<M,<a, and p(M,;)=0_ otherwise. 


(a) Calculate the characteristic function for each element M,;;. 

(b) Calculate the characteristic function for the trace of the matrix, T=trM =)°, M,,. 

(c) What does the central limit theorem imply about the probability density function of 
the trace at large N? 

(d) For large N, each eigenvalue A, (a = 1,2,--- , N) of the matrix M is distributed 


according to a probability density function 


2 | 
P(A)= rT 1 vi for Ag <A<Ag, and p(A)=0_ otherwise 
Tg 0 


(known as the Wigner semicircle rule). Find the variance of 2. 


(Hint. Changing variables to A = Ay sin @ simplifies the integrals.) 
(e) If, in the previous result, we have A? = 4Na’/3, can the eigenvalues be independent 
of each other? 


2K 2k ok ok kK 


9. Random deposition: a mirror is plated by evaporating a gold electrode in vac- 
cum by passing an electric current. The gold atoms fly off in all directions, 
and a portion of them sticks to the glass (or to other gold atoms already on 
the glass plate). Assume that each column of deposited atoms is independent 
of neighboring columns, and that the average deposition rate is d layers per 
second. 


(a) What is the probability of m atoms deposited at a site after a time t? What fraction 
of the glass is not covered by any gold atoms? 
(b) What is the variance in the thickness? 


2K ok ok ok kK 


10. Diode: the current J across a diode is related to the applied voltage V via J = 
Iy [exp(eV/kT) — 1]. The diode is subject to a random potential V of zero mean and 
variance o”, which is Gaussian distributed. Find the probability density p(/) for the 


11. 


12. 


Problems 


current / flowing through the diode. Find the most probable value for /, the mean value 
of 7, and indicate them on a sketch of p(J). 


2k 2k 2K Kok ook 


Mutual information: consider random variables x and y, distributed according to a joint 


probability p(x, y). The mutual information between the two variables is defined by 


P(x y) ) 


M(x, y) =D p(x, y)In Gono 


where p, and p, denote the unconditional probabilities for x and y. 


(a) Relate M(x, y) to the entropies S(x, y), S(x), and S(y) obtained from the correspond- 
ing probabilities. 


(b) Calculate the mutual information for the joint Gaussian form 
ax? 
P(x, y) « exp (-> -——- cxy) : 


2k 2k 2K ook KK 


Semi-flexible polymer in two dimensions: configurations of a model polymer can be 
described by either a set of vectors {t;} of length a in two dimensions (for i= 1,--- , N), 
or alternatively by the angles {@;} between successive vectors, as indicated in the figure 


below. 


The polymer is at a temperature T, and subject to an energy 
N-1 N-1 
H=-k >) t;-t,,=—Ka’ > cosd,, 
i=l i=l 
where x is related to the bending rigidity, such that the probability of any configuration 


is proportional to exp (—A(/k,T). 


(a) Show that (t 
length £, = ag. (You can leave the answer as the ratio of simple integrals.) 


-t,,) «exp (—|n — m|/€), and obtain an expression for the persistence 


m 


(b) Consider the end-to-end distance R as illustrated in the figure. Obtain an expression 
for (R?) in the limit of N > 1. 
(c) Find the probability p(R) in the limit of N > 1. 


55 


56 


Probability 


(d) If the ends of the polymer are pulled apart by a force F, the probabilities for polymer 
configurations are modified by the Boltzmann weight exp (#8). By expanding this 


weight, or otherwise, show that 
(R) =K'F+0(F°), 


and give an expression for the Hookian constant K in terms of quantities calculated 
before. 


2K OK OK OK OK OK KK 


3 
Kinetic theory of gases 


3.1 General definitions 


Kinetic theory studies the macroscopic properties of large numbers of 
particles, starting from their (classical) equations of motion. 


Thermodynamics describes the equilibrium behavior of macroscopic objects 
in terms of concepts such as work, heat, and entropy. The phenomenological 
laws of thermodynamics tell us how these quantities are constrained as a 
system approaches its equilibrium. At the microscopic level, we know that 
these systems are composed of particles (atoms, molecules), whose interactions 
and dynamics are reasonably well understood in terms of more fundamental 
theories. If these microscopic descriptions are complete, we should be able to 
account for the macroscopic behavior, that is, derive the laws governing the 
macroscopic state functions in equilibrium. Kinetic theory attempts to achieve 
this objective. In particular, we shall try to answer the following questions: 


1. How can we define “equilibrium” for a system of moving particles? 
2. Do all systems naturally evolve towards an equilibrium state? 


3. What is the time evolution of a system that is not quite in equilibrium? 


The simplest system to study, the veritable workhorse of thermodynamics, is the 
dilute (nearly ideal) gas. A typical volume of gas contains of the order of 1073 
particles, and in kinetic theory we try to deduce the macroscopic properties of 
the gas from the time evolution of the set of atomic coordinates. At any time f, 
the microstate of a system of N particles is described by specifying the positions 
q;(t), and momenta p,(t), of all particles. The microstate thus corresponds to 
a point w(t), in the 6N-dimensional phase space T = []M,{q;, p;}. The time 
evolution of this point is governed by the canonical equations 


dq, 0H 

ar ah (3.1) 
dp, dH 

dt aq, 


where the Hamiltonian F((p,q) describes the total energy in terms of the 
set of coordinates q = {q),4,--:,qy}, and momenta p = {p), p>, --- , Py}- 
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Fig. 3.1 The phase space 
density is proportional to 
the number of 
representative points in 
an infinitesimal volume. 


Kinetic theory of gases 


The microscopic equations of motion have time reversal symmetry, that is, if 
all the momenta are suddenly reversed, p —~ —p, at t = 0, the particles retrace 
their previous trajectory, q(t) = q(—1). This follows from the invariance of Ft 
under the transformation T(p, q) > (—p, q). 


As formulated within thermodynamics, the macrostate M of an ideal gas 
in equilibrium is described by a small number of state functions such as E, 
T, P, and N. The space of macrostates is considerably smaller than the phase 
space spanned by microstates. Therefore, there must be a very large number of 
microstates corresponding to the same macrostate M. 

This many-to-one correspondence suggests the introduction of a statisti- 
cal ensemble of microstates. Consider NV copies of a particular macrostate, 
each described by a different representative point p(t) in the phase space I. 
Let dN (p, q, t) equal the number of representative points in an infinitesimal 
volume dl = ne ,d°p,d°q; around the point (p,q). A phase space density 
p(p, q, t) is then defined by 


dN (p,q. t 
p(p, q, td = lim mea 


at > (3.2) 


This quantity can be compared with the objective probability introduced in the 
previous section. Clearly, { dlp = 1 and p is a properly normalized probability 
density function in phase space. To compute macroscopic values for various 
functions O(p, q), we shall use the ensemble averages 


(0) = | dlp(p. 4. NOC. 4). (3.3) 


When the exact microstate yz is specified, the system is said to be in a 
pure state. On the other hand, when our knowledge of the system is prob- 
abilistic, in the sense of its being taken from an ensemble with density 
p(1), it is said to belong to a mixed state. It is difficult to describe equi- 
librium in the context of a pure state, since y(t) is constantly changing in 
time according to Eqs. (3.1). Equilibrium is more conveniently described for 
mixed states by examining the time evolution of the phase space density 
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p(t), which is governed by the Liouville equation introduced in the next 
section. 


3.2 Liouville’s theorem 


Liouville’s theorem states that the phase space density p(I,t) behaves like 
an incompressible fluid. 


r Fig. 3.2 Time evolution of 
a volume element in 
: phase space. 
RAR bee ae aie ie tote pan 
1 — 


Follow the evolution of dN pure states in an infinitesimal volume dl = 
TIM, 4p; 43g; around the point (p, q). According to Eqs. (3.1), after an interval 
ot these states have moved to the vicinity of another point (p’, q’), where 


Ge =a t Ga5t + O51’), Py = Pa t+ P_dt + O(5"’). (3.4) 


In the above expression, the g, and p, refer to any of the 6N coordinates and 
momenta, and q, and p, are the corresponding velocities. The original volume 
element dI° is in the shape of a hypercube of sides dp, and dq,. In the time 
interval df it gets distorted, and the projected sides of the new volume element 
are given by 


ee 
dq, = dq, + oe dq5t + (812) 

- (3.5) 
IPa 


dp,6t+ O(8P) 
dp 


dp), = dpa t+ 


——— 


Qa 


To order of 51?, the new volume element is dI’ = [][",d°p,’ d°q,’. From 
Eqs. (3.5) it follows that for each pair of conjugate coordinates 


itn, APa 
day -4Pi, = dad | 1+ (SE + )ar+ocr)]. (3.6) 


Qa Qa 
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But since the time evolution of coordinates and momenta are governed by the 
canonical Eqs. (3.1), we have 


WG. 9 0H PH dp, 4a ( a) = PH 
~  @ 


; . (3.7) 
2 a Da OP ag Pa Pa \ 94g da9P a 


Thus the projected area in Eq. (3.6) is unchanged for any pair of coordinates, 
and hence the volume element is unaffected, dI’ = dI’. All the pure states 
dN originally in the vicinity of (p,q) are transported to the neighborhood 
of (p’,q’), but occupy exactly the same volume. The ratio dW//dI is left 
unchanged, and p behaves like the density of an incompressible fluid. 


The incompressibility condition p(p’, q’, t+ 6t) = p(p, q, t) can be written 
in differential form as 


dp _ dp > ap dpa , 9p dda 
dt at dp, dt  dqy dt 


=0. (3.8) 


Note the distinction between dp/dt and dp/dt: the former partial derivative 
refers to the changes in p at a particular location in phase space, while the 
latter total derivative follows the evolution of a volume of fluid as it moves in 
phase space. oe from Eq. (3.1) into Eq. (3.8) leads to 


dp dp OK dp 0H 
Pu We Ma Pa 


=—{p, H}, (3.9) 


where we have end the Poisson bracket of two functions in phase space 
as 


(+ 0B 0A 7) = {BA}. (3.10) 


3 
A,Bh= . : 
Aer= & Ada 9Pa OP 9a 


a=1 


Consequences of Liouville’s theorem: 


1. Under the action of time reversal, (p,q, *) > (—p,q, —t), the Poisson bracket {p, Ft} 
changes sign, and Eq. (3.9) implies that the density reverses its evolution, that is, 
P(P, 4, 1) = p(—P. 4, —2). 

2. The time evolution of the ensemble average in Eq. (3.3) is given by (using Eq. (3.9)) 


d F) oN dp 0H dp JH 
Saf eee o@.a=% [ arow.a (32-5 — seo). 
at = IPa 9a a IPa 


(3.11) 


The partial derivatives of p in the above equation can be removed by using the method 


of integration by parts, that is, f fp’ = —f pf’ since p vanishes on the boundaries of the 


integrations, leading to 


a0) = yf dtp (=. OH +0 PH PH )] 


Ada 94a PPe IP aa 94a Pa 


= -| dT p{H, O} = ({O, H}). 
(3.12) 


3.2 Liouville’s theorem 


Note that the total time derivative cannot be taken inside the integral sign, that is, 


d(O) dp(p, 4, t) 
ere ee rae 


This common mistake yields d (QO) /dt = 0. 


. If the members of the ensemble correspond to an equilibrium macroscopic state, the 


O(p, q). (3.13) 


ensemble averages must be independent of time. This can be achieved by a stationary 


density dp,,/dt = 0, that is, by requiring 
{Poq, H} = 0. (3.14) 


A possible solution to the above equation is for p,, to be a function of J, that is, p.,(P, q) = 
p(IC(p, q)). It is then easy to verify that {p(H), H} = p'(H){H, H} = 0. This solution 
implies that the value of p is constant on surfaces of constant energy JC, in phase space. This 
is indeed the basic assumption of statistical mechanics. For example, in the microcanonical 
ensemble, the total energy E of an isolated system is specified. All members of the ensemble 
must then be located on the surface H((p, q) = E in phase space. Equation (3.9) implies 
that a uniform density of points on this surface is stationary in time. The assumption of 
statistical mechanics is that the macrostate is indeed represented by such a uniform density of 
microstates. This is equivalent to replacing the objective measure of probability in Eq. (3.2) 
with a subjective one. 

There may be additional conserved quantities associated with the Hamiltonian that 
satisfy {L,,, J(} = 0. In the presence of such quantities, a stationary density exists for any 
function of the form p,,(p,q) = p(H(p. q), L,(p. q). L2(p. q),---). Clearly, the value 


of L,, is not changed during the evolution of the system, since 


dL, (p,q) abn (p(t-+dr), q(t+dr)) — L, (p(), a(a)) 


dt di 
a > OL, Pa + OL, 04a 
~<\ap, at | qq at (3.15) 


eS 


a=1 


SN (AL, OH OL, dH 
. ‘ = ft Ess KH} = 0; 


Pa a Wa Pa 
Hence, the functional dependence of p,, on these quantities merely indicates that all 
accessible states, that is, those that can be connected without violating any conservation 
law, are equally likely. 

. The above postulate for p,, answers the first question posed at the beginning of this chapter. 
However, in order to answer the second question, and to justify the basic assumption of 
statistical mechanics, we need to show that non-stationary densities converge onto the 
stationary solution p,,. This contradicts the time reversal symmetry noted in point (1) 
above: for any solution p(t) converging to p,,, there is a time-reversed solution that 
diverges from it. The best that can be hoped for is to show that the solutions p(t) are in 
the neighborhood of p,, the majority of the time, so that time averages are dominated by 
the stationary solution. This brings us to the problem of ergodicity, which is whether it is 
justified to replace time averages with ensemble averages. In measuring the properties of 
any system, we deal with only one representative of the equilibrium ensemble. However, 
most macroscopic properties do not have instantaneous values and require some form 
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of averaging. For example, the pressure P exerted by a gas results from the impact of 
particles on the walls of the container. The number and momenta of these particles vary 
at different times and different locations. The measured pressure reflects an average over 
many characteristic microscopic times. If over this time scale the representative point of 
the system moves around and uniformly samples the accessible points in phase space, we 
may replace the time average with the ensemble average. For a few systems it is possible 
to prove an ergodic theorem, which states that the representative point comes arbitrarily 
close to all accessible points in phase space after a sufficiently long time. However, the 
proof usually works for time intervals that grow exponentially with the number of particles 
N, and thus exceed by far any reasonable time scale over which the pressure of a gas is 
typically measured. As such the proofs of the ergodic theorem have so far little to do with 
the reality of macroscopic equilibrium. 


3.3 The Bogoliubov-—Born-Green-Kirkwood-Yvon 
hierarchy 


The full phase space density contains much more information than neces- 
sary for description of equilibrium properties. For example, knowledge of the 
one-particle distribution is sufficient for computing the pressure of a gas. A 
one-particle density refers to the expectation value of finding any of the N 
particles at location g, with momentum Pp, at time tf, which is computed from 
the full density p as 


i=1 


N 

fi@. 450) -(x BB p)BG— i) 
(3.16) 
=N [TL 8B, 806) = Bet =F. Bode Buoys 
i=2 

To obtain the second identity above, we used the first pair of delta functions 
to perform one set of integrals, and then assumed that the density is symmetric 
with respect to permuting the particles. Similarly, a two-particle density can be 
computed from 


filPr dis Bas 1) = MN = 1) [ I dV, P(P1. Ms Po» Q2s°** Pye Gyet), — (3.17) 


i=3 


where dV, = d*p, d°q; is the contribution of particle i to phase space volume. 
The general s-particle density is defined by 


Diets .g dV; Patel? dl 
f, Pr Ip th= won! p(p, q. ‘= wn wo (Pi, st), (3 8) 


where p, is a standard unconditional PDF for the coordinates of s particles, 
and py =p. While p, is properly normalized to unity when integrated over 
all its variables, the s-particle density has a normalization of N!/(N —s)!. We 
shall use the two quantities interchangeably. 


3.3 The Bogoliubov-Born—Green-Kirkwood-Yvon hierarchy 


The evolution of the few-body densities is governed by the BBGKY hierar- 
chy of equations attributed to Bogoliubov, Born, Green, Kirkwood, and Yvon. 
The simplest non-trivial Hamiltonian studied in kinetic theory is 


Nyro 2 N 
x(p.a) =| +uG)]+5 2 VGA). (3.19) 
iat L <7 2 (i,)=1 
This Hamiltonian provides an adequate description of a weakly interacting gas. 
In addition to the classical kinetic energy of particles of mass m, it contains 
an external potential U, and a two-body interaction V, between the particles. 
In principle, three- and higher-body interactions should also be included for a 
complete description, but they are not very important in the dilute gas (nearly 
ideal) limit. 

For evaluating the time evolution of f,, it is convenient to divide the 
Hamiltonian into 


H=H,+Hy +H’, (3.20) 


where F(, and F(,_, include only interactions among each group of particles, 


S 


#,=¥ [+ UG) +5 LPG. an) 


(n,m)=1 
(3.21) 
[Bi 1 — 
Hy => [Esua]+s O VG-a 
i=sp1 b <1 (i,J=st1 
while the interparticle interactions are contained in 
H => Yo VGH) (3.22) 
n=1 i=s+l 
From Eq. (3.18), the time evolution of f, (or p,) is obtained as 
0 
os = I av, 2 =-/ 7 dV, {(p, H,+Hy_,+H'}, (3.23) 


i=s+1 ims 
where Eq. (3.9) is used for the evolution of p. The three Poisson brackets in 
Eq. (3.23) will now be evaluated in turn. Since the first s coordinates are not 
integrated, the order of integrations and differentiations for the Poisson bracket 
may be reversed in the first term, and 


i=s+1 i=s+1 


J Tl ey, wocia{(f IT av, A) 26} = 2) (3.24) 


Writing the Poisson brackets explicitly, the second term of Eq. (3.23) takes the 
form 


-f TT avi to.%ed=f TT av, sl as se acs] 


aor int Op; 9G; = 9G; 
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(using Eq. (3.21)) 


-{tla,> 


i=s+1 j=s+l 


a au 1 S av(gj;—4 dp P; 
eo GW) _ % Pil_9 G25) 
OP; \ 9G; 2 yo 995 dq; m 
The last equality is obtained after performing the integrations by part: the term 
multiplying 0p/dp, has no dependence on p,, while p;/m does not depend on 
qj- The final term in Eq. (3.23), involving the Poisson bracket with H’, is 


dp dH' ap aa 
6p; 94; 44; OP 


fT av ¥| 


i=s+l j=l ‘i 


=| i dV, b 3 ae Ds 3 se y late i 
i=s4l n=l Pn jas+l In jest CP] ne ay 

where the sum over all particles has been subdivided into the two groups. 
(Note that A’ in Eq. (3.22) has no dependence on the momenta.) Integration 
by parts shows that the second term in the above expression is zero. The first 
term involves the sum of (N —s) expressions that are equal by symmetry and 
simplifies to 


2 SVG, — 4 a 
(v—s) [ I] dV, Ss (Gn - 541) . la 
i=s+1 n=1 Igy OP, 


=w-9¥ | oy, Pde. 2) f i ay, ) 


(3.26) 


n=l O4n Pn i=s+2 


Note that the quantity in the above square brackets is p,,,. Thus, adding up 
Eqs. (3.24), (3.25), and (3.26), 


dp : IV(Gu = Fei) Pst 
ep) (N= / dV. came 3.27 
at { Ss ps} ( 8) X stl 0G, OP, ( ) 
or in terms of the densities f,, 
of, * IV(4, = s+) Ofsa1 
CE ae a / dV peated 3.28 
at { S fs } » s+l1 OG, OP, ( ) 


In the absence of interactions with other particles, the density p, for a group 
of s particles evolves as the density of an incompressible fluid (as required 
by Liouville’s theorem), and is described by the streaming terms on the left- 
hand side of Eq. (3.27). However, because of interactions with the remaining 
N —s particles, the flow is modified by the collision terms on the right-hand 
side. The collision integral is the sum of terms corresponding to a potential 
collision of any of the particles in the group of s, with any of the remaining 
N—s particles. To describe the probability of finding the additional particle 
that collides with a member of this group, the result must depend on the 
joint PDF of s+ 1 particles described by p,,,. This results in a hierarchy of 
equations in which dp, /dt depends on p>, dp,/dt depends on p3, etc., which is 
at least as complicated as the original equation for the full phase space density. 


3.4 The Boltzmann equation 


To proceed further, a physically motivated approximation for terminating the 
hierarchy is needed. 


3.4 The Boltzmann equation 


To estimate the relative importance of the different terms appearing in 
Eqs. (3.28), let us examine the first two equations in the hierarchy, 


0 ou Oo Pp 0 aV(g, -—g 0 
| Moan Pi. ° ]« =f dV, OVA) alae (3.29) 
ot dq, Op, m dq aq, OP 
and 

E aU 8 WU d fp, da pf a IV(q,-H) ( aa Ne 
dt dg, OP, AG IPy m dq m Aq aq, OP, Py ? 

aV(g, -g 0 OV(G.-G 0 
=} dV, | (4 3) : (G2 qa) : |4: (3.30) 

aq, OP agp OP2 


Note that two of the streaming terms in Eq. (3.30) have been combined by 
using 0V(q, — q)/0q, = —9V (Go — 41) /0q>, which is valid for a symmetric 
potential such that V(g, — gq.) = V(q. — 4). 

Time scales: all terms within square brackets in the above equations have 
dimensions of inverse time, and we estimate their relative magnitudes by 
dimensional analysis, using typical velocities and length scales. The typical 
speed of a gas particle at room temperature is v © 10? ms~!. For terms involving 
the external potential U, or the interatomic potential V, an appropriate length 
scale can be extracted from the range of variations of the potential. 


(a) The terms proportional to 


involve spatial variations of the external potential U(q), which take place over macro- 
scopic distances L. We shall refer to the associated time 7, as an extrinsic time scale, 
as it can be made arbitrarily long by increasing system size. For a typical value of 
L¥10-}m, we get Ty © L/v¥ 10s. 

(b) From the terms involving the interatomic potential V, we can extract two additional time 


scales, which are intrinsic to the gas under study. In particular, the collision duration 


is the typical time over which two particles are within the effective range d of their 
interaction. For short-range interactions (including van der Waals and Lennard-Jones, 
despite their power law decaying tails), d © 10~!° m is of the order of a typical atomic 
size, resulting in T. © 107". This is usually the shortest time scale in the problem. The 
analysis is somewhat more complicated for long-range interactions, such as the Coulomb 
gas in a plasma. For a neutral plasma, the Debye screening length A replaces d in the 
above equation, as discussed in the problems. 
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Fig. 3.3. The mean free 
time between collisions is 
estimated by requiring 
that there is only one 
other particle in the 
volume swept in time 7,. 
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(c) There are also collision terms on the right-hand side of Eqs. (3.28), which depend on 


Fc415 and lead to an inverse time scale 


i ova ova 

~~ fav 2% fu. dy ye, 
T dq op fs dq OP Ps 
The integrals are only non-zero over the volume of the interparticle potential d*. The 
term f,,,/f, is related to the probability of finding another particle per unit volume, 
which is roughly the particle density n = N/V © 10°6m~?. We thus obtain the mean free 


time 


T. 1 
T&S ~ 


* “nd nvd2’ 


(31) 


which is the typical distance a particle travels between collisions. For short-range inter- 
actions, 7, * 1078s is much longer than 7,, and the collision terms on the right-hand 
side of Eqs. (3.28) are smaller by a factor of nd? (107° m~3)(107!° m)? © 1074. 


The Boltzmann equation is obtained for short-range interactions in the dilute 
regime by exploiting 7,/7,. nd? < 1. (By contrast, for long-range interactions 
such that nd? >> 1, the Vlasov equation is obtained by dropping the collision 
terms on the left-hand side, as discussed in the problems.) From the above 
discussion, it is apparent that Eq. (3.29) is different from the rest of the 
hierarchy: it is the only one in which the collision terms are absent from the 
left-hand side. For all other equations, the right-hand side is smaller by a factor 
of nd?, while in Eq. (3.29) it may indeed dominate the left-hand side. Thus a 
possible approximation scheme is to truncate the equations after the first two, 
by setting the right-hand side of Eq. (3.30) to zero. 

Setting the right-hand side of the equation for f, to zero implies that the 
two-body density evolves as in an isolated two-particle system. The relatively 
simple mechanical processes that govern this evolution result in streaming 
terms for f, that are proportional to both 7! and 77'. The two sets of terms 
can be more or less treated independently: the former describe the evolution of 
the center of mass of the two particles, while the latter govern the dependence 
on relative coordinates. 

The density f, is proportional to the joint PDF p, for finding one particle at 
(P;, 4), and another at (p, g,), at the same time f. It is reasonable to expect 
that at distances much larger than the range of the potential V, the particles are 
independent, that is, 
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Po(Pis G+ Pas Go+t) —> PP H>t)P1 (Pr, 42,0), oF 
(3.32) 


{ f2(Pie Ui Pa» bs) —> fii UH OFi Pr h: 0) for |q—4q|>d. 


Fig. 3.4 Particles 
escaping into an initially 
empty container through 


Es a hole. 
ites 


The above statement should be true even for situations out of equilibrium. For 
example, imagine that the gas particles in a chamber are suddenly allowed 
to invade an empty volume after the removal of a barrier. The density /; 
will undergo a complicated evolution, and its relaxation time will be at least 
comparable to Ty. The two-particle density f, will also reach its final value at 
a comparable time interval. However, it is expected to relax to a form similar 
to Eq. (3.32) over a much shorter time of the order of 7,. 


; Fig. 3.5 The schematic 
hr behavior of a two-body 
density as a function of 
Aili,t) filo, an 
relative coordinates. 
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For the collision term on the right-hand side of Eq. (3.29), we actually 
need the precise dependence of f, on the relative coordinates and momenta 
at separations comparable to d. At time intervals longer than 7, (but possibly 
shorter than 7,,), the “steady state” behavior of f, at small relative distances is 
obtained by equating the largest streaming terms in Eq. (3.30), that is, 


Pp 0 Pp 0 6V(q, -G 0 0 
E eae P2 | c (a ) . ( : ° )]« -~0. (3.33) 
m dq, m dq, dq, dp, OP» 
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Fig. 3.6 The parameters 
used to describe the 
collision of two particles 
in their center of mass (at 
a=0) frame, which 
moves with a conserved 
momentum 
P=p,+P,=P;'+P’. In 
an elastic collision, the 
relative momentum fp is 
rotated by solid angle ©. 
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We expect f,(q), 9) to have slow variations over the center of mass coor- 
dinate Q = (q;+9>)/2, and large variations over the relative coordinate 


= h%— 4. Therefore, df,/Iq > Af,/AQ, and df,/q, ~ —df,/dq, © Ofr/ 04, 


leading to 

6V(q,-—g 0 0 Pi-P 0 

(4 b/ : )a= (2 me). a7 (3.34) 
aq, OP; OP» m oq 


The above equation provides a precise mathematical expression for how f, 
is constrained along the trajectories that describe the collision of the two 
particles. 

The collision term on the right-hand side of Eq. (3.29) can now be written as 


~ a OV(G-| F) a 
=] d*p, dq, (a 4) ( = > )h 
coll. aq, OP; OP» 


s anf Po=P Os oe SS 
~ | dp, PG (oP) 2 i Btndo ts), 


af 
di 


(3.35) 


The first identity is obtained from Eq. (3.29) by noting that the added term 
proportional to df,/dp, is a complete derivative and integrates to zero, while 
the second equality follows from Eq. (3.34), after the change of variables to 
d= %—4- (Since it relies on establishing the “steady state” in the relative 
coordinates, this approximation is valid as long as we examine events in time 
with a resolution longer than 7...) 

Kinematics of collision and scattering: the integrand in Eq. (3.35) is a 
derivative of f, with respect to g along the direction of relative motion p = 
P>— P, Of the colliding particles. To perform this integration we introduce a 
convenient coordinate system for g, guided by the formalism used to describe 
the scattering of particles. Naturally, we choose one axis to be parallel to 
P>— P;, With the corresponding coordinate a that is negative before a collision, 
and positive afterwards. The other two coordinates of g are represented by an 


p=(P\—P2) /2 
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impact vector b that is 0 for a head-on collision ([p, — p>] || [G, — 4]). We can 
now integrate over a to get 


=| dp, db |v, — Vo| [Gr D> Po b, +31) — falPis N: Pas b, -3 |, 


coll. 
(3.36) 


where |¥, — | = |p, — Bo|/mis the relative speed of the two particles, with (b, —) 
and (b, +) referring to relative coordinates before and after the collision. Note 
that d2b |v, — v,| is just the flux of particles impinging on the element of area ab. 

In principle, the integration over a is from —oo to +o, but as the variations 
of f, are only significant over the interaction range d, we can evaluate the 
above quantities at separations of a few d from the collision point. This is a 
good compromise, allowing us to evaluate f, away from the collisions, but 
at small enough separations so that we can ignore the difference between q, 
and q,. This amounts to a coarse graining in space that eliminates variations 
on scales finer than d. With these provisos, it is tempting to close the equa- 
tion for f,, by using the assumption of uncorrelated particles in Eq. (3.32). 
Clearly some care is necessary as a naive substitution gives zero! The key 
observation is that the densities f, for situations corresponding to before and 
after the collision have to be treated differently. For example, soon after open- 
ing of the slot separating empty and full gas containers, the momenta of 
the gas particles are likely to point away from the slot. Collisions will tend 
to randomize momenta, yielding a more isotropic distribution. However, the 
densities f, before and after the collision are related by streaming, imply- 
ing that f.(P,, 91, P2,b, +5 1) = fx(Pi's H. P2', b, —3 1), where p,' and p,’ are 
momenta whose collision at an impact vector b results in production of out- 
going particles with momenta p, and p,. They can be obtained using time 
reversal symmetry, by integrating the equations of motion for incoming col- 
liding particles of momenta —p, and —p,. In terms of these momenta, we can 
write 


= d°p, WPd|v, —W,| [AG "5G Pr 1b, -3 1) — fa(Pis Ns Pas b. -: | : 
(3.37) 


It is sometimes more convenient to describe the scattering of two parti- 
cles in terms of the relative momenta p = p,; — p, and p' = p,'— p,’, before 
and after the collision. For a given b, the initial momentum p is determin- 
istically transformed to the final momentum p’. To find the functional form 
P' (P|; b), one must integrate the equations of motion. However, it is possi- 
ble to make some general statements based on conservation laws: in elastic 
collisions, the magnitude of p is preserved, and it merely rotates to a final 
direction indicated by the angles (6, 6) = A(b) (a unit vector) in spherical 
coordinates. Since there is a one-to-one correspondence between the impact 
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Fig. 3.7 The scattering of 
two hard spheres of 
diameter D, at an impact 
parameter b= |b |. 
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vector b and the solid angle O, we make a change of variables between the two, 
resulting in 


df, 


di [br — bal [ far! tas Ba’ B=) 


da 
=/ &p,7?O |— 
/ os pa 


coll. 


(3.38) 
—fr(Pis Ms Pr» b, -; | . 


The Jacobian of this transformation, |da/dQ|, has dimensions of area, and is 
known as the differential cross-section. It is equal to the area presented to an 
incoming beam that scatters into the solid angle 0. The outgoing momenta 
Pp,’ and p,’ in Eq. (3.38) are now obtained from the two conditions p,’+ 
Po’ =P, +P» (conservation of momentum), and p,'— py’ = |p, — p.|A(b) 
(conservation of energy), as 


[ b.' = (1 +P. +1, — PolQG)) /2, 
_ (3.39) 
bee (1 +P: — |i — Pal) /2. 
For the scattering of two hard spheres of diameter D, it is easy to show that 
the scattering angle is related to the impact parameter b by cos(0/2) = b/D for 
all @. The differential cross-section is then obtained from 


dé D? D* 


0 2 


Wo = bdbdd = Dcos (5) Dsin (5) 


(Note that the solid angle in three dimensions is given by d’O = sin @ déd¢.) 
Integrating over all angles leads to the total cross-section of @ = 7D”, which is 
evidently correct. The differential cross-section for hard spheres is independent 
of both 6 and P|. This is not the case for soft potentials. For example, the 
Coulomb potential V = e”/ |O| leads to 


_ me : 
~ \ a) sin2(6/2) ] 


do 
dO, 
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(The dependence on |P| can be justified by obtaining a distance of closest 
approach from |P|?/m-+ e?/b ~ 0.) 
The Boltzmann equation is obtained from Eq. (3.38) after the substitution 


AP P23) =f, (PiU. Ar 10), (3.40) 
known as the assumption of molecular chaos. Note that even if one starts 
with an uncorrelated initial probability distribution for particles, there is no 
guarantee that correlations are not generated as a result of collisions. The final 
result is the following closed form equation for /;: 


0d o0U oa Pp, 4a 
=o +. |f,= 
ot Og, OP, m dq, 


-| d*p, vo, |v, — v,| [iG Ge OA Par dis )— fish Of Po. A t)]. 


(3.41) 


do 
dO 


Given the complexity of the above “derivation” of the Boltzmann equa- 
tion, it is appropriate to provide a heuristic explanation. The streaming terms 
on the left-hand side of the equation describe the motion of a single parti- 
cle in the external potential U. The collision terms on the right-hand side 
have a simple physical interpretation: the probability of finding a particle of 
momentum p, at q, is suddenly altered if it undergoes a collision with another 
particle of momentum p,. The probability of such a collision is the product 
of kinematic factors described by the differential cross-section |da/dQ|, the 
“flux” of incident particles proportional to |v, —v,|, and the joint probability 
of finding the two particles, approximated by f,(p,)f;(p2). The first term on 
the right-hand side of Eq. (3.41) subtracts this probability and integrates over 
all possible momenta and solid angles describing the collision. The second 
term represents an addition to the probability that results from the inverse 
process: a particle can suddenly appear with coordinates (p,, q,) as a result 
of a collision between two particles initially with momenta p,' and p,’. The 
cross-section, and the momenta (p, ', p,'), may have a complicated dependence 
on (p;, p>) and Q, determined by the specific form of the potential V. Remark- 
ably, various equilibrium properties of the gas are quite independent of this 
potential. 


3.5 The H-theorem and irreversibility 


The second question posed at the beginning of this chapter was whether a 
collection of particles naturally evolves toward an equilibrium state. While it 
is possible to obtain steady state solutions for the full phase space density pj, 
because of time reversal symmetry these solutions are not attractors of generic 
non-equilibrium densities. Does the unconditional one-particle PDF p, suffer 
the same problem? While the exact density p, must necessarily reflect this 
property of p,,, the H-theorem proves that an approximate p,, governed by the 


71 


72 


Kinetic theory of gases 


Boltzmann equation, does in fact non-reversibly approach an equilibrium form. 
This theorem states that: 


Tf f,\(p, q, t) satisfies the Boltzmann equation, then dH/dt < 0, where 
H() = [ P0G LF. 4.9 In f,(B. 4.9. (3.42) 


The function H(f) is related to the information content of the one-particle PDF. 
Up to an overall constant, the information content of p, = f,;/N is given by 
Z[p,] = (np,), which is clearly similar to H(7). 


Proof. The time derivative of H is 


=f ead 3g “A inti fap dq nfist “hs ; (3.43) 


since [ dV, f, = N { dlp =N is time-independent. Using Eq. (3.41), we obtain 


i a au a Pp, 0 
saa =| #p, aq, Inf, ( =~ ’ Pi, i 
dq, Opi m dq 


=f PR, PG Pp Poli, — | [Gr HAG H) 
— fi(Py', HW) Ai Bo’ H)] fi Pr, 41): (3.44) 


where we shall interchangeably use d’a, d*b, or d?Q|da/dQ| for the differ- 
ential cross-section. The streaming terms in the above expression are zero, as 
shown through successive integrations by parts, 


ou Of, oU 1 Of, 
fer eq nf SS =-[ 0, aA SS 
dq, OP, a es dp 
0U 
=f Ph CHAS =a = 0, 
ap, 9q, 


Pi - 35 vn f Bt. 1 oft 32 ag 0 Pi 

— dp, dq d = 0: 
a ae ee 

The collision term in Eq. (3.44) involves integrations over dummy variables 

P, and p,. The labels (1) and (2) can thus be exchanged without any change 

in the value of the integral. Averaging the resulting two expressions gives 


dH 1 " 
aL dq dp, d°p, d bia, — vy| [fi (Pi) fi Pr) 
dr 2 (3.45) 


fir fi Po ‘)| In (fi (Pidfi (Py) . 


(The arguments, g and t, of f; are suppressed for ease of notation.) We 
would now like to change the variables of integration from the coordinates 
describing the initiators of the collision, (p,, p>, b), to those of their products, 
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(P,', P's b’). The explicit functional forms describing this transformation are 
complicated because of the dependence of the solid angle Qin Eq. (3.39) on b 
and |p, — p,|. However, we are assured that the Jacobian of the transformation 
is unity because of time reversal symmetry; since for every collision there is 
an inverse one obtained by reversing the momenta of the products. In terms of 
the new coordinates 


dH 1 > > 27 Tn > > > 
== 5 [8G Dap! Cbd —B| [AG IAG») 


dt (3.46) 
—f, (P Si (P2 ‘)] In (fi PDA (P2)) , 


where we should now regard (p,, p) in the above equation as functions of 
the integration variables (p,’, p,’, b’) as in Eq. (3.39). As noted earlier, |v, — 
V>| = |v,;’—v,'| for any elastic collision, and we can use these quantities 
interchangeably. Finally, we relabel the dummy integration variables such that 
the primes are removed. Noting that the functional dependence of (p,, p>, b) 
on (p;', Po’; b') is exactly the same as its inverse, we obtain 


dH _ 1 39 43> Gao G27 i> 3 > aa] 
ap gf PFPA, PP, CHB, —¥21 [AP AG) oan 
—fi(Pdhi (Pr) In (fi; (Pi) fi Po ’)) : 
Averaging Eqs. (3.45) and (3.47) results in 
dH 1 ~ 
—=-- | dg d’p, dp, bd, -0 Pi) fi (Bo) — fir Vi Po" 
ang PFD VP, Pd, —¥2) [A PIAP)— AP A)] — 


[In (fi PDS (P>)) —In (f1 (Pi fi Po ‘))] . 


The integrand of the above expression is always positive. If f,(p,)f;(P2) > 
f(P, Df; (2), both terms in square brackets are positive, while both are neg- 
ative if f,(P,) fi (D2) < f,:(P1 ) fF, (pr’). In either case, their product is positive. 
The positivity of the integrand establishes the validity of the H-theorem, 


— <0. (3.49) 


Irreversibility: the second law is an empirical formulation of the vast number 
of everyday observations that support the existence of an arrow of time. Rec- 
onciling the reversibility of laws of physics governing the microscopic domain 
with the observed irreversibility of macroscopic phenomena is a fundamental 
problem. Of course, not all microscopic laws of physics are reversible: weak 
nuclear interactions violate time reversal symmetry, and the collapse of the 
quantum wave function in the act of observation is irreversible. The former 
interactions in fact do not play any significant role in everyday observations 
that lead to the second law. The irreversible collapse of the wave function may 
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itself be an artifact of treating macroscopic observers and microscopic observ- 
ables distinctly.! There are proponents of the view that the reversibility of the 
currently accepted microscopic equations of motion (classical or quantum) is 
indicative of their inadequacy. However, the advent of powerful computers 
has made it possible to simulate the evolution of collections of large numbers 
of particles, governed by classical, reversible equations of motion. Although 
simulations are currently limited to relatively small numbers of particles (10°), 
they do exhibit the irreversible macroscopic behaviors similar to those observed 
in nature (typically involving 107° particles). For example, particles initially 
occupying one half of a box proceed to irreversibly, and uniformly, occupy 
the whole box. (This has nothing to do with limitations of computational accu- 
racy; the same macroscopic irreversibility is observed in exactly reversible 
integer-based simulations, such as with cellular automata.) Thus the origin of 
the observed irreversibilities should be sought in the classical evolution of large 
collections of particles. 

The Boltzmann equation is the first formula we have encountered that 
is clearly not time reversible, as indicated by Eq. (3.49). We can thus ask 
the question of how we obtained this result from the Hamiltonian equations 
of motion. The key to this, of course, resides in the physically motivated 
approximations used to obtain Eq. (3.41). The first steps of the approximation 
were dropping the three-body collision term on the right-hand side of Eq. (3.30), 
and the implicit coarse graining of the resolution in the spatial and temporal 
scales. Neither of these steps explicitly violates time reversal symmetry, and 
the collision term in Eq. (3.37) retains this property. The next step in getting 
to Eq. (3.41) is to replace the two-body density f,(—), evaluated before the 
collision, with the product of two one-body densities according to Eq. (3.32). 
This treats the two-body densities before and after the collision differently. 
We could alternatively have expressed Eq. (3.37) in terms of the two-body 
densities f,(+) evaluated after the collision. Replacing f,(+) with the product 
of two one-particle densities would then lead to the opposite conclusion, with 
dH/dt > 0! For a system in equilibrium, it is hard to justify one choice over 
the other. However, once the system is out of equilibrium, for example, as 
in the situation of Fig. 3.4, the coordinates after the collision are more likely 
to be correlated, and hence the substitution of Eq. (3.32) for f,(+) does not 
make sense. Time reversal symmetry implies that there should also be subtle 
correlations in f,(—) that are ignored in the so-called assumption of molecular 
chaos. 

While the assumption of molecular chaos before (but not after) collisions is 
the key to the irreversibility of the Boltzmann equation, the resulting loss of 


' The time-dependent Schrédinger equation is fully time reversible. If it is possible to write a 
complicated wave function that includes the observing apparatus (possibly the whole Universe), 
it is hard to see how any irreversibility may occur. 
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information is best justified in terms of the coarse graining of space and time: 
the Liouville equation and its descendants contain precise information about the 
evolution of a pure state. This information, however, is inevitably transported 
to shorter scales. A useful image is that of mixing two immiscible fluids. While 
the two fluids remain distinct at each point, the transitions in space from one 
to the next occur at finer resolution on subsequent mixing. At some point, a 
finite resolution in any measuring apparatus will prevent keeping track of the 
two components. In the Boltzmann equation, the precise information of the 
pure state is lost at the scale of collisions. The resulting one-body density only 
describes space and time resolutions longer than those of a two-body collision, 
becoming more and more probabilistic as further information is lost. 


3.6 Equilibrium properties 


What is the nature of the equilibrium state described by /,, for a homogeneous 
gas? 

(1) The equilibrium distribution: after the gas has reached equilibrium, 
the function H should no longer decrease with time. Since the integrand in 
Eq. (3.48) is always positive, a necessary condition for dH/dt = 0 is that 


fi (P,; asi (Po, Hn) —fi (P ‘s Wi (Po ? n) =0, (3.50) 


that is, at each point q we must have 


Inf, (@.4)+Iinf, (P29) =Inf, (p,q) +n f, (Po, g). (3.51) 


The left-hand side of the above equation refers to the momenta before a two- 
body collision, and the right-hand side to those after the collision. The equality 
is thus satisfied by any additive quantity that is conserved during the collision. 
There are five such conserved quantities for an elastic collision: the particle 
number, the three components of the net momentum, and the kinetic energy. 
Hence, a general solution for f; is 


aes 
inf, =alG)-a@)-3-BG)(-). (3.52) 


We can easily accommodate the potential energy U(q) in the above form, and 


set 
2. 


AD.) = "Gero Ce ea (2 +0). (3.53) 


2m 


We shall refer to the above distribution as describing local equilibrium. While 
this form is preserved during collisions, it will evolve in time away from 
collisions, due to the streaming terms, unless {#,, f, } = 0. The latter condition 
is satisfied for any function f, that depends only on AC ,, or any other quantity 
that is conserved by it. Clearly, the above density satisfies this requirement as 
long as NW and B are independent of g, and a = 0. 
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According to Eq. (3.16), the appropriate normalization for f, is 
[& PGA 0.4) =N. (3.54) 


For particles in a box of volume V, the potential U(q) is zero inside the 
box, and infinite on the outside. The normalization factor in Eq. (3.53) can be 
obtained from Eq. (3.54) as 


es 3 in\ 3? a 
venv|[ ap,exp (~a:p,- 52) =v (=) op (SE). (3.55) 


Hence, the properly normalized Gaussian distribution for momenta is 


3/2 > > 
Aaa) =n( B ) exp| PC), (3.56) 


277m 2m 


where Py = (p)= ma/B is the mean value for the momentum of the gas, which 
is zero for a stationary box, and n = N/V is the particle density. From the 
Gaussian form of the distribution it can be easily concluded that the variance 
of each component of the momentum is ( P;) = m/B, and 


(r")= (eh +93 +92) = G37) 


(2) Equilibrium between two gases: consider two different gases (a) and 
(b), moving in the same potential U, and subject to a two-body interaction 
V4 (4 —q ). We can define one-particle densities, fi? and f\”, for the 
two gases, respectively. In terms of a generalized collision integral 


doy g 
dO, 


Cup=— | PR, PO | 


fo - tA [Nr WA? Gra) 
(3.58) 


fOr AP Gr!) 


the evolution of these densities is governed by a simple generalization of the 
Boltzmann equation to 


(a) 
[ af =-{ (a) HO \ +c Co . 
uf (3.59) 
af,” (6) qr(b) 
[|= =-| 1 Hy b+ nat Cue 


Stationary distributions can be obtained if all six terms on the right-hand 
side of Eqs. (3.59) are zero. In the absence of interspecies collisions, that is, 
for C, , = C,, =9, we can obtain independent stationary distributions i x 
exp (-8.%\”) and a x exp (8,51). Requiring the vanishing of C, , 
leads to the additional constraint, 


FOG)? GE) -fFO GIAO Ge") =0, = 


(a) > (b) (> \ (a)(> 7 (b) 73 7 (3.60) 
BUH (Pi) +ByH, (Po) = BiH (Pi) + BH, (P2’)- 


3.6 Equilibrium properties 


Since the total energy H - +H : is conserved in a collision, the above 
equation can be satisfied for B, = 6, = B. From Eq. (3.57) this condition 
implies the equality of the kinetic energies of the two species, 


Pe \_/ m\_ 3 
(2 ~ (2 ~ 28° (3.61) 


The parameter 6 thus plays the role of an empirical temperature describing the 


equilibrium of gases. 


(3) The equation of state: to complete the identification of B with temperature 
T, consider a gas of N particles confined to a box of volume V. The gas 
pressure results from the force exerted by the particles colliding with the walls 
of the container. Consider a wall element of area A perpendicular to the x 
direction. The number of particles impacting this area, with momenta in the 
interval [p, p+dp], over a time period 61, is 


dN (p) =(f,(p)d°p)(A v, 62). (3.62) 


The final factor in the above expression is the volume of a cylinder of height 
v,6t perpendicular to the area element A. Only particles within this cylinder 
are close enough to impact the wall during 6t. As each collision imparts a 
momentum 2p, to the wall, the net force exerted is 


= 5 [. dp. | . dp, [ ; dp.fi(B) (A = 61) 2p,). (3.63) 


As only particles with velocities directed toward the wall will hit it, the first 
integral is over half of the range of p,. Since the integrand is even in p,, this 
restriction can be removed by dividing the full integral by 2. The pressure P 
is then obtained from the force per unit area as 


F - _ 2 1 . 3/2 2 
Bee =[ ep Ape = — [a's Py n(-) exp (-F) = a (3.64) 


27m 2m 


Fig. 3.8 The pressure 
exerted on the wall due 
to impact of particles. 


77 


78 


Kinetic theory of gases 


where Eq. (3.56) is used for the equilibrium form of f,. Comparing with 
the standard equation of state, PY = Nk,T, for an ideal gas, leads to the 
identification, B = 1/k,T. 

(4) Entropy: as discussed earlier, the Boltzmann H-function is closely related 
to the information content of the one-particle PDF p,. We can also define a 
corresponding Boltzmann entropy, 


Sp(t) = —kpH(2), (3.65) 


where the constant k, reflects the historical origins of entropy. The H-theorem 
implies that S, can only increase with time in approaching equilibrium. It has 
the further advantage of being defined through Eq. (3.42) for situations that 
are clearly out of equilibrium. For a gas in equilibrium in a box of volume V, 
from Eq. (3.56), we compute 


H=V [dp f,(b)Inf,() 
a 7 P n Pp 
= vf dp —(2amk,T) >” I 
P val mmk pT)“ exp 2mk,T ‘ (2a7mk,T)3/? 2mk pT 


n 3 


The entropy is now identified as 


3. 3 N 
Sz = —kgH = Nkg| = + =In(2amk,T) —In( — ) |. (3.67) 
2 2 V 
The thermodynamic relation, TdS, = dE + PdV, implies 
OE 0 
2 ee Nkp, 
aT |) Tie 2 
(3.68) 
p JE| _ 7 Se) _ Nhat 
|, Wl, V~ 


The usual properties of a monatomic ideal gas, PV = NkgT, and E = 3Nk,T/2, 
can now be obtained from the above equations. Also note that for this classical 
gas, the zero temperature limit of the entropy in Eq. (3.67) is not independent 
of the density n, in violation of the third law of thermodynamics. 


3.7 Conservation laws 


Approach to equilibrium: we now address the third question posed in the 
introduction, of how the gas reaches its final equilibrium. Consider a situation 
in which the gas is perturbed from the equilibrium form described by Eq. (3.56), 
and follow its relaxation to equilibrium. There is a hierarchy of mechanisms 
that operate at different time scales. 


(i) The fastest processes are the two-body collisions of particles in immediate vicinity. Over 
a time scale of the order of 7,, fy(G), 42, ¢) relaxes to f,(4;, 0 f,(@, t) for separations 
|G; — | > d. Similar relaxations occur for the higher-order densities f,. 


3.7 Conservation laws 


(ii) At the next stage, f, relaxes to a local equilibrium form, as in Eq. (3.53), over the time 
scale of the mean free time 7,,. This is the intrinsic scale set by the collision term on the 
right-hand side of the Boltzmann equation. After this time interval, quantities conserved 
in collisions achieve a state of local equilibrium. We can then define at each point a 


(time-dependent) local density by integrating over all momenta as 


nG.=[ CPG: (3.69) 


as well as a local expectation value for any operator O(p, q, t), 
7 1 hh has wk Ps 
(04.9) = —— | @AfG.4.906.4.9. (3.70) 
n(q, 0) 


(iii) After the densities and expectation values have relaxed to their local equilibrium forms 
in the intrinsic time scales 7, and T,,, there is a subsequent slower relaxation to global 
equilibrium over extrinsic time and length scales. This final stage is governed by the 
smaller streaming terms on the left-hand side of the Boltzmann equation. It is most 
conveniently expressed in terms of the time evolution of conserved quantities according 
to hydrodynamic equations. 


Conserved quantities are left unchanged by the two-body collisions, that is, 
they satisfy 


X(P1> 4 1) + X(P2, 42) = XP's + X(P2', 9,0); (3.71) 
where (p,, P>) and (p,’, p»’) refer to the momenta before and after a collision, 


respectively. For such quantities, we have 


. a 7 3 a A 24 
JG.0= [ PPXG.40 TH) (G0 =0. (3.72) 


coll. 


Proof. Using the form of the collision integral, we have 
Jy == [ PB, Pp Pld, -H| [ABI G)-— AG fib] x@)-— G.73) 


(The implicit arguments (q,f) are left out for ease of notation.) We now 
perform the same set of changes of variables that were used in the proof of the 
H-theorem. The first step is averaging after exchange of the dummy variables 
P, and p>, leading to 


1 = 3S Tis b3 * pad 5 a | cn ee st kad 
k=-5f d’p, d"p, db |v, — v4! [fi if (Pr) — fi @ )Fi Po ) [x(P,) + x(P)] - 
(3.74) 


Next, change variables from the originators (Dy. Pr. b) to the products 
(p,', P>', b’) of the collision. After relabeling the integration variables, the 
above equation is transformed to 


1 n . Sie 5 es a 
K=—5 f OD dp, abv, — | [f, (BF, 2) 


=f PDS (P2)] [xP ‘) + x(P2')] . 


(3.75) 
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Averaging the last two equations leads to 
1 > > Liz > > > > 7 > 7 
Jy = 4 / d’p, dp, adv, —v)| [fi (Pi fi Pr) — fi Pi fi Po ) 
(3.76) 
[x@1) + x(P2) — X(P1') — X@2')], 
which is zero from Eq. (3.71). 
Let us explore the consequences of this result for the evolution of expecta- 


tion values involving y. Substituting for the collision term in Eq. (3.72) the 
streaming terms on the left-hand side of the Boltzmann equation lead to 


or pe a — 
a= PPG] A+ a+ | AG I=0 BID 
m OPa 


where we have introduced the notations 0, = 0/dt, 0, = 0/0q,, and F, = 
—dU/0q,. We can manipulate the above equation into the form 


: a " F 
fer{la+? a,+F, ea fi] a+ 2a, + Fag |x} =o. (3.78) 
m OPa m Op 


Qa 


The third term is zero, as it is a complete derivative. Using the definition of 
expectation values in Eq. (3.70), the remaining terms can be rearranged into 


a,(n(x)) +44 (n( 22x) —n (a,x) —n(724,.} nk) =o (3.79) 


As discussed earlier, for elastic collisions, there are five conserved quantities: 
particle number, the three components of momentum, and kinetic energy. Each 
leads to a corresponding hydrodynamic equation, as constructed below. 

(a) Particle number: setting y = 1 in Eq. (3.79) leads to 


0n+0,(nu,) = 0, (3.80) 


where we have introduced the local velocity 


i=(2). (3.81) 


m 


This equation simply states that the time variation of the local particle density 
is due to a particle current J, =n. 

(b) Momentum: any linear function of the momentum p is conserved in the 
collision, and we shall explore the consequences of the conservation of 


@= 2-3. (3.82) 
m 
Substituting c, into Eq. (3.79) leads to 
F. 
dg (n((ug + Cg) Ca)) +Nd,Ug + NIgUy (Ug + Cg) — ans =0. (3.83) 


Taking advantage of (c,) = 0, from Eqs. (3.81) and (3.82), leads to 


w 1 


F. 
OU + Ugdguy = i. = min bras 5 (3.84) 


3.7 Conservation laws 


where we have introduced the pressure tensor, 
Pup = mn (CqCp)- (3.85) 


The left-hand side of the equation is the acceleration of an element of the fluid 
du/dt, which should equal Fix /m according to Newton’s equation. The net 
force includes an additional component due to the variations in the pressure 
tensor across the fluid. 

(c) Kinetic energy: we first introduce an average local kinetic energy 


mc2 DP ~ mu 
= = . : 3.86 
fac ess 
and then examine the conservation law obtained by setting y equal to mc” /2 
in Eq. (3.79). Since for space and time derivatives de = mcgdcg = —mcgdug, 
we obtain 
mc 
0,(né)+d, (: (( + cy) ~)) +nmd,Ug (cg) +nmdyup (ug + Ca) Cp) 
2 (3.87) 
—nF, (Cy) =0. 
Taking advantage of (c,) = 0, the above equation is simplified to 
mc? 
0, (ne) + Ou (nu,é) + On (»(c.}) + PupIatp =0. (3.88) 


We next take out the dependence on n in the first two terms of the above 
equation, finding 


£0,N+N0,E + E0q (NUg) +NUgIgé + Ighg + Papltag = 9, (3.89) 


where we have also introduced the local heat flux 


h= > (cae?) (3.90) 
and the rate of strain tensor 
1 
Uap = 5 (dqug + Agita) - (3.91) 


Eliminating the first and third terms in Eq. (3.89) with the aid of Eq. (3.80) 
leads to 


1 1 
4,¢+U,5,8 = ——dyhy — —Paglag- (3.92) 

n n 
Clearly, to solve the hydrodynamic equations for n, u, and €, we need expres- 
sions for P,g and h, which are either given phenomenologically, or calculated 


from the density /f,, as in the next sections. 
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3.8 Zeroth-order hydrodynamics 


As a first approximation, we shall assume that in local equilibrium, the density 
f, at each point in space can be represented as in Eq. (3.56), that is, 


n(q, 1) (p—mi(G, t))” 
(20mk,T(G, 1)” 2mk,T(q,t) | 


AB. 4.0 = (3.93) 
The choice of parameters clearly enforces { d°p f? =n, and (p/ m)” =U, as 
required. Average values are easily calculated from this Gaussian weight; in 
particular, 


a RT 
: = ; 3.94 
(cag) moe (3.94) 
leading to 
3 
Pia =nkpTb.g, and e= a kal- (3.95) 


Since the density f? is even in ¢, all odd expectation values vanish, and in 
particular 


h° =0. (3.96) 
The conservation laws in this approximation take the simple forms 


[ D,n = —N0,Ug 
1 
mD,U, = Fy ~ 708 (nk,T) . (3.97) 


2 
D,T= a 
In the above expression, we have introduced the material derivative 
D, = (8, + ugd,]_. (3.98) 


which measures the time variations of any quantity as it moves along the 
stream-lines set up by the average velocity field u. By combining the first and 
third equations, it is easy to get 


D,in (aT?) =0, (3.99) 


The quantity In(n7~*/) is like a local entropy for the gas (see Eq. (3.67)), 
which according to the above equation is not changed along stream-lines. The 
zeroth-order hydrodynamics thus predicts that the gas flow is adiabatic. This 
prevents the local equilibrium solution of Eq. (3.93) from reaching a true global 
equilibrium form, which necessitates an increase in entropy. 

To demonstrate that Eqs. (3.97) do not describe a satisfactory approach to 
equilibrium, examine the evolution of small deformations about a stationary 
(U4) = 0) state, in a uniform box (F = 0), by setting 


| n(q, t) = 7+V(G, t) 


(| 74.1) = T +0, 1) 


(3.100) 


3.8 Zeroth-order hydrodynamics 


We shall next expand Eqs. (3.97) to first order in the deviations (v, 0, i). 
Note that to lowest order, D, = 0,++ O(u), leading to the linearized zeroth-order 
hydrodynamic equations 


kpT 
| MO,Ug = ———— IV — kp 0,8 | (3.101) 


Normal modes of the system are obtained by Fourier transformations, 
A (k. w) = i PGdr exp i (Cz ;- w)| A(@,t), (3.102) 


where A stands for any of the three fields (v, 6, it). The natural vibration 
frequencies are solutions to the matrix equation 


b 0 nike 0 b 
Oita} =| Eroapke 9 — Bdapke | | ip | - (3.103) 
0 0 2Tkg 0 0 


It is easy to check that this equation has the following modes, the first three 
with zero frequency: 


(a) Two modes describe shear flows in a uniform (n = 7) and isothermal (T = 7) fluid, in 
which the velocity varies along a direction normal to its orientation (e.g., u = f(x, t)¥). 
In terms of Fourier modes k- i(k) = 0, indicating transverse flows that are not relaxed 
in this zeroth-order approximation. 

(b) A third zero-frequency mode describes a stationary fluid with uniform pressure P = 
nk,T. While n and T may vary across space, their product is constant, insuring that the 
fluid will not start moving due to pressure variations. The corresponding eigenvector of 
Eq. (3.103) is 


7 
v.=| 0 |. (3.104) 


(c) Finally, the longitudinal velocity (u, || k) combines with density and temperature varia- 


tions in eigenmodes of the form 


milk 
v=| o(k) ], with = w(k) = £v,]kI, (3.105) 
3T|k| 
where 
5kpT 
v=, = (3.106) 
3m 


is the longitudinal sound velocity. Note that the density and temperature variations in 
this mode are adiabatic, that is, the local entropy (proportional to In (nT~*/ *)) is left 


unchanged. 
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We thus find that none of the conserved quantities relaxes to equilibrium in 
the zeroth-order approximation. Shear flow and entropy modes persist forever, 
while the two sound modes have undamped oscillations. This is a deficiency 
of the zeroth-order approximation that is removed by finding a better solution 
to the Boltzmann equation. 


3.9 First-order hydrodynamics 


While f?(p, q, t) of Eq. (3.93) does set the right-hand side of the Boltzmann 
equation to zero, it is not a full solution, as the left-hand side causes its form 
to vary. The left-hand side is a linear differential operator, which using the 
various notations introduced in the previous sections, can be written as 


Pa a F, a 
Lifl= + dat Fas fa| Di+6,0,+ 5 —|F (3.107) 


It is simpler to examine the effect of £ on In f?, which can be written as 


Inf? =In(nT~*”) — me ii (2mmk,) (3.108) 
; Q2k,T 2 Be , 
Using the relation d(c?/2) = cgdcg = —cgdug, we get 


mc” DT+ m 
==. 
A i Pr 


i, 0,n 30,T 4 mc? aT+ m 9 FC 
Cc Cc = C6 Upg— . 
a oe a PO eae Py a ai ae Oe 


L[in f?] = D, In (nT~*) + D,Ug 


(3.109) 


If the fields n, T, and u,, satisfy the zeroth-order hydrodynamic Eqs. (3.97), 
we can simplify the above equation to 


var fo] =o mc ry Fy On  0,T rm d,n 3 0,T Fy 
cs i A a ed a n 27) ksT 


12 


m 
2,7? eet + Erte 


+ 
(3.110) 


The characteristic time scale ty for £ is extrinsic, and can be made much 
larger than 7,.. The zeroth-order result is thus exact in the limit (7,./7y) > 0; 
and corrections can be constructed in a perturbation series in (7,./7,). To this 
purpose, we set f, = f;(1 +g), and linearize the collision operator as 


Cif. fil= = [ Pp. bi; — v1 f) (Bi) f} (Br) [s(P,) + 8(P2) — 8(P1) — 8(P2')] 


= —f/@)C,[sl- (3.111) 


3.9 First-order hydrodynamics 


While linear, the above integral operator is still difficult to manipulate in 
general. As a first approximation, and noting its characteristic magnitude, we 


set 
~ & 
Cig] ¥ =. (3.112) 
This is known as the single collision time approximation, and from the lin- 
earized Boltzmann equation L[f,] = —f?C,[g], we obtain 
1 
ge ale ne ine | (3.113) 
1 


where we have kept only the leading term. Thus the first-order solution is given 
by (using Eq. (3.110)) 


aye a Tm Sap > 
iG (P, 9,1) = i. qt) E - (co p ) Uap 


me 5 Ca 9 , 
T, : 
*\OeT 2) TP" 


where 7, = Tx = 7,, in the single collision time approximation. However, in 


(3.114) 


writing the above equation, we have anticipated the possibility of 7, 4 7x, 
which arises in more sophisticated treatments (although both times are still of 
order of 7,,). 

It is easy to check that [d?pf} = {d°pf? =n, and thus various local 
expectation values are calculated to first order as 


(0)' = : [ POA +8) = (0) +(e)’. (3.115) 


The calculation of averages over products of c,’s, distributed according to the 
Gaussian weight of f?, is greatly simplified by the use of Wick’s theorem, 
which states that expectation value of the product is the sum over all possible 
products of paired expectation values, for example 
ar 
(Gx¢gCyCs),= (7) (6.655 + 5 ay5g5 + S55py) - (3.116) 


(Expectation values involving a product of an odd number of c,’s are zero by 
symmetry.) Using this result, it is easy to verify that 


0 
Pa\! OpT [( me* _ 5), 
(22) a a 2k,T 2 CoCg) = Ua (3.117) 


The pressure tensor at first order is given by 


Tm 6 ° 
gcc =m tent (o(anr 822 0] 
B 


6 
= nkpTbyg —2nk,TT, (1a — “2 u,) : 


(3.118) 


85 


86 


Kinetic theory of gases 


(Using the above result, we can further verify that e! = (mc? / a = 3k,T/2, as 
before.) Finally, the heat flux is given by 


(3.119) 


At this order, we find that spatial variations in temperature generate a heat 
flow that tends to smooth them out, while shear flows are opposed by the 
off-diagonal terms in the pressure tensor. These effects are sufficient to cause 
relaxation to equilibrium, as can be seen by examining the modified behavior 
of the modes discussed previously. 


(a) The pressure tensor now has an off-diagonal term 


Pigp = —2nkgT 7, Uap = —M (Iqlg + Igta) » (3.120) 


a 


where “ = nk,Tt, is the viscosity coefficient. A shearing of the fluid (e.g., described by 
a velocity u,(x, t)) now leads to a viscous force that opposes it (proportional to wd;u,), 
causing its diffusive relaxation as discussed below. 


(b) Similarly, a temperature gradient leads to a heat flux 
h = —KVT, (3.121) 


where K = (5nk377x)/(2m) is the coefficient of thermal conductivity of the gas. If the 


gas is at rest (4 = 0, and uniform P = nk,T), variations in temperature now satisfy 


2K 


= WT. 122 
3nks Ce 


3 
n0,6 = kd, T =-40,(—Kd,T), => 47 
This is the Fourier equation and shows that temperature variations relax by diffusion. 


We can discuss the behavior of all the modes by linearizing the equations 
of motion. The first-order contribution to D,u, © 0,U, is 

Stuja eee (aes 3.123 

(0;ua) = 955 Pag © — 7 — | 3 Fad p+ Sap 5y9y } Ug, (3.123) 


mn 
where pp = nk pl ts Similarly, the correction for D,T ~ 0,0 is given by 


2 2K 
5! (4,0) = Oyly © — 4,040, (3.124) 
3kpgn 3kgn 


with K = (5”k7,7TT,)/(2m). After Fourier transformation, the matrix equa- 
tion (3.103) is modified to 


D 0 NO pkg 0 D 

~ |_| Ts 7, i+ (228 Kake\ keg op 7 12 
@ | ta | = | mm Oapke inn (K Oop + “z~) in Oapks | | tp | - (3.125) 

0 31S apke =a) 


Problems 


We can ask how the normal mode frequencies calculated in the zeroth-order 
approximation are modified at this order. It is simple to verify that the transverse 
(shear) normal models (k - #7 = 0) now have a frequency 


one ie, (3.126) 
mn 

The imaginary frequency implies that these modes are damped over a char- 
acteristic time 7,(k) ~ 1/|,;| ~ AiG) where A is the corresponding 
wavelength, and v ~ ,/k,T7/m is a typical gas particle velocity. We see that 
the characteristic time scales grow as the square of the wavelength, which is 

the signature of diffusive processes. 
In the remaining normal modes the velocity is parallel to k, and Eq. (3.125) 


reduces to 


D 0 nk 0 v 
w| ig) =| 27a i= Ee | [ae]. (3.127) 
r) 0 27k ie f) 


The determinant of the dynamical matrix is the product of the three eigenfre- 
quencies, and to lowest order is given by 


2Kk ky Tk 
det(M) = i—— -nk- —— 
3k gn mn 


+ O(7%). (3.128) 


At zeroth order the two sound modes have w.(k) = +v,k, and hence the 
frequency of the isobaric mode is 


det(M) 2Kk? 
=-i 
—vik? 5k gn 


wl (k) © +0(72). (3.129) 


At first order, the longitudinal sound modes also turn into damped oscillations 
with frequencies w!,(k) = tv,k —iy. The simplest way to obtain the decay 
rates is to note that the trace of the dynamical matrix is equal to the sum of 
the eigenvalues, and hence 


Qu 2K 
' (k) =+0,k —ik? 2). .130 
aa ee Sn Gee NT) GD 


The damping of all normal modes guarantees the, albeit slow, approach of the 
gas to its final uniform and stationary equilibrium state. 


Problems for chapter 3 


1. One-dimensional gas: a thermalized gas particle is suddenly confined to a one- 
dimensional trap. The corresponding mixed state is described by an initial density 


function p(q, p, t = 0) = 6(q)f(p), where f(p) = exp(—p*/2mk,T)/.,/27mk ,T. 


(a) Starting from Liouville’s equation, derive p(q, p, t) and sketch it in the (q, p) plane. 


2 


(b) Derive the expressions for the averages (q ) and (p?) at t>0. 


(c) Suppose that hard walls are placed at g = +Q. Describe p(q, p, t >> 7), where 7 is 
an appropriately large relaxation time. 
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(d) A “coarse-grained” density p is obtained by ignoring variations of p below some 
small resolution in the (q, p) plane; for example, by averaging p over cells of the 
resolution area. Find p(q, p) for the situation in part (c), and show that it is stationary. 


2K 2k KOK 2K KK 


2. Evolution of entropy: the normalized ensemble density is a probability in the phase space 
I. This probability has an associated entropy S(t) = — f dIp(T, 1) In p(T, 2). 


(a) Show that if p(T, f) satisfies Liouville’s equation for a Hamiltonian H, dS/dt = 0. 

(b) Using the method of Lagrange multipliers, find the function p,,,(I) that maxi- 
mizes the functional S[p], subject to the constraint of fixed average energy, (H() = 
falpH = E. 

(c) Show that the solution to part (b) is stationary, that is, 0p,,,,/0t = 0. 


(d) How can one reconcile the result in (a) with the observed increase in entropy as 
the system approaches the equilibrium density in (b)? (Hint. Think of the situation 
encountered in the previous problem.) 
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3. The Vlasov equation is obtained in the limit of high particle density n = N/V, or large 
interparticle interaction range A, such that nA? >> 1. In this limit, the collision terms are 
dropped from the left-hand side of the equations in the BBGKY hierarchy. 

The BBGKY hierarchy 


0 5p, OU 5. ({ 0uU OV(d, -— 9 0 
s+n =(3 +) (In i). | 


n=1 m Ody, n=1 Qn £ An 
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z V4, — 4 0 
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has the characteristic time scales 
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ty oq dp L 
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where nA} is the number of particles within the interaction range A, and v is a typical 
velocity. The Boltzmann equation is obtained in the dilute limit, nA* < 1, by disregarding 
terms of order 1/7, < 1/7,. The Vlasov equation is obtained in the dense limit of 


nd} > 1 by ignoring terms of order 1/7. < 1/7,,.. 


(a) Assume that the N-body density is a product of one-particle densities, that is, p = 
mn 1 P\(X;, t), where x; = (B;, ai): Calculate the densities f,, and their normalizations. 


Problems 


(b) Show that once the collision terms are eliminated, all the equations in the BBGKY 


hierarchy are equivalent to the single equation 


a,b 4 Ug a 
am oq oq dp 


ne. 7.1) =0, 


where 


User(s) = UG) + [ dx VG-4') fi, 0. 


(c) Now consider N particles confined to a box of volume V, with no addi- 


tional potential. Show that /,(9,p) = g(p)/V is a stationary solution to the 
Vlasov equation for any g(p). Why is there no relaxation toward equilibrium for 
8(p)? 
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4. Two-component plasma: consider a neutral mixture of N ions of charge +e and mass 


m.,, and N electrons of charge —e and mass m_, in a volume V = N/no. 


(a) Show that the Vlasov equations for this two-component system are 


(b) 


(c) 


E p 9 ID 9 


Ses p,q, t)=0 
am, oq aq a] fo.a ) 
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where the effective Coulomb potential is given by 


Poe (G. 1) = PalG) +e f Ox CG-G)[A.&.N—F-09]. 


Here, ®,,, is the potential set up by the external charges, and the Coulomb potential 
C(q) satisfies the differential equation V7C = 4767(q). 
Assume that the one-particle densities have the stationary forms f, = g,(p)n.(q@). 


Show that the effective potential satisfies the equation 
VD tp = ATPext oE 4ire (n,(4) Nn (q )) ? 


where p,,, is the external charge density. 


Further assuming that the densities relax to the equilibrium Boltzmann weights 


ns(q) = no exp[+Be®,;(4)] leads to the self-consistency condition 
VO. =47 [Pext + Nge (cFePer =a e PePerr) | ; 


known as the Poisson—Boltzmann equation. Due to its non-linear form, it is generally 
not possible to solve the Poisson—Boltzmann equation. By linearizing the exponen- 


tials, one obtains the simpler Debye equation 
V? Dts = ATPext oF Deep/A?. 


Give the expression for the Debye screening length X. 
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(d) Show that the Debye equation has the general solution 
(= | PY GG -F)Pow(G), 


where G(q) = exp(—|q|/A)/|q| is the screened Coulomb potential. 

(e) Give the condition for the self-consistency of the Vlasov approximation, and interpret 
it in terms of the interparticle spacing. 

(f) Show that the characteristic relaxation time (7 © A/v) is temperature-independent. 
What property of the plasma is it related to? 
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. Two-dimensional electron gas in a magnetic field: when donor atoms (such as 


P or As) are added to a semiconductor (e.g., Si or Ge), their conduction elec- 
trons can be thermally excited to move freely in the host lattice. By growing lay- 
ers of different materials, it is possible to generate a spatially varying potential 
(work-function) that traps electrons at the boundaries between layers. In the fol- 
lowing, we shall treat the trapped electrons as a gas of classical particles in two 
dimensions. 

If the layer of electrons is sufficiently separated from the donors, the main source of 
scattering is from electron—electron collisions. 


(a) The Hamiltonian for non-interacting free electrons in a magnetic field has the form 


“02 
(7; = eA) S 
H=> | —~ 24,18 


2m 


(The two signs correspond to electron spins parallel or anti-parallel to the field.) 
The vector potential A=Bx q/2 describes a uniform magnetic field B. Obtain the 
classical equations of motion, and show that they describe rotation of electrons in 
cyclotron orbits in a plane orthogonal to B. 

(b) Write down heuristically (i.e., not through a step-by-step derivation) the Boltzmann 
equations for the densities f,(p, q, t) and f, (p,q, t) of electrons with up and down 
spins, in terms of the two cross-sections o = On = Fy, and 0, = On of spin 
conserving collisions. 

(c) Show that dH/dt < 0, where H=H,+ Hy, is the sum of the corresponding 
H-functions. 

(d) Show that dH/dt = 0 for any In f that is, at each location, a linear combination of 
quantities conserved in the collisions. 

(e) Show that the streaming terms in the Boltzmann equation are zero for any function 
that depends only on the quantities conserved by the one-body Hamiltonians. 

(f) Show that angular momentum L= q X Pp is conserved during, and away from, colli- 
sions. 

(g) Write down the most general form for the equilibrium distribution functions for 
particles confined to a circularly symmetric potential. 


(h) 
(i) 


Problems 


How is the result in part (g) modified by including scattering from magnetic and 
non-magnetic impurities? 
Do conservation of spin and angular momentum lead to new hydrodynamic equations? 
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6. The Lorentz gas describes non-interacting particles colliding with a fixed set of scat- 


terers. It is a good model for scattering of electrons from donor impurities. Consider 


a uniform two-dimensional density ny of fixed impurities, which are hard circles of 


radius a. 


(a) 


(b) 


(c) 
(d) 


(e) 


(f) 


(g) 


Show that the differential cross-section of a hard circle scattering through an angle 
0 is 

do = = sin 8 dé, 

2 2 

and calculate the total cross-section. 
Write down the Boltzmann equation for the one-particle density f(g, p, t) of the 
Lorentz gas (including only collisions with the fixed impurities). (Ignore the electron 
spin.) 
Find the eigenfunctions and eigenvalues of the collision operator. 
Using the definitions F = —dU/0g, and 


5 eter s 1 Si as ib e 
n(q, j= | Paha b. t), and (g(q,1))= aa) dp fq. p. t)g(4. 1). 


show that for any function y(|p|), we have 


zon) => (3) 


Derive the conservation equation for local density p = mn(@, £), in terms of the local 
velocity u= (p/ m). 

Since the magnitude of particle momentum is unchanged by impurity scattering, the 
Lorentz gas has an infinity of conserved quantities |p|”. This unrealistic feature is 
removed upon inclusion of particle—particle collisions. For the rest of this problem 
focus only on p?/2m as a conserved quantity. Derive the conservation equation for 


the energy density 
eq, = Fic’), where C= 


in terms of the energy flux h= plé c’) /2, and the pressure tensor Pg = P(CaCp)- 


Starting with a one-particle density 


2; 
0”2, > > P : 
Zt= rt 2 gt)’ 
f (Pp. 9.0) =n(q Vex 2mk,T(q, | 2amk ,T(G, t) 


reflecting local equilibrium conditions, calculate 7, h, and P.g- Hence obtain the 
zeroth-order hydrodynamic equations. 
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(h) Show that in the single collision time approximation to the collision term in the 


Boltzmann equation, the first-order solution is 


Oo fee 2 p [danp ant p oT F 
40) =F C450) |1 ‘(=> - - 
f(R4a0=f (PR. | ues ( i ig + onk,T? aq kT 


(i) Show that using the first-order expression for f, we obtain 
pu=nt [F- k,TVIn (p7)| : 


(j) From the above equation, calculate the velocity response function X,2 = 0U,/0F,. 
(k) Calculate P,,, and h, and hence write down the first-order hydrodynamic 


equations. 
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. Thermal conductivity: consider a classical gas between two plates separated by a distance 


w. One plate at y = 0 is maintained at a temperature 7,, while the other plate at y = w 
is at a different temperature T,. The gas velocity is zero, so that the initial zeroth-order 
approximation to the one-particle density is 

n(y) a | PP 
[2amkgT(y)}"” 2mkgT(y) 


Fey D= 


(a) What is the necessary relation between n(y) and T(y) to ensure that the gas velocity 
u remains zero? (Use this relation between n(y) and T(y) in the remainder of this 
problem.) 


(b) Using Wick’s theorem, or otherwise, show that 


(p’)’ = (PyPa)” =3(mkgT), and (p*) =(p,P_PgPs) = 15 (mkgT), 


where (0° indicates local averages with the Gaussian weight f?. Use the result 


(p°)° = 105(mk,T)* in conjunction with symmetry arguments to conclude 
(p>p*)? = 35 (mkgT). 


(c 


Near 


The zeroth-order approximation does not lead to relaxation of temperature/density 
variations related as in part (a). Find a better (time-independent) approximation 
fi (p, y), by linearizing the Boltzmann equation in the single collision time approxi- 


mation to 


1_ £0 
ola]~[F+22] oy fi fi 


TK 


where Tx is of the order of the mean time between collisions. 
(d) Use f}, along with the averages obtained in part (b), to calculate h,, the y com- 
ponent of the heat transfer vector, and hence find K, the coefficient of thermal 


conductivity. 


Problems 


(e) What is the temperature profile, T(y), of the gas in steady state? 
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. Zeroth-order hydrodynamics: the hydrodynamic equations resulting from the conserva- 


tion of particle number, momentum, and energy in collisions are (in a uniform box): 
[ On+0, (nug) = 0 
0,Ug +Ugd ! OgP. 
Uy +Ugdguy = —— ; 
tla Bopta mn & %® 
| 0,6 + U,d l, h tp 
e+u,d,E =-— ——P. gu 
t ava n ata n apap 
where n is the local density, 7 = (p/m), Uap = (Igy + Ogg) /2, and & = (mc? /2), with 
c= 5 i=. 


(a) For the zeroth-order density 


A@.Gt) = 


mt) | (B= mi. 9)” 
(24mk Tq, 1)” 2mkgT(q,t) |’ 


calculate the pressure tensor Pee = mn(cycp) » and the heat flux he — am(c,c /2)°. 

(b) Obtain the zeroth-order hydrodynamic equations governing the evolution of n(q, 1), 
u(q, t), and T(q, t). 

(c) Show that the above equations imply D, In (nT~9/?) = 0, where D, = 0, + ugg is the 
material derivative along stream-lines. 

(d) Write down the expression for the function H°(t) = f d°gd? pf? (p, q, t) In f? (Pp, g, 0), 
after performing the integrations over p, in terms of n(q, t), u(q, t), and T(@, f). 

(e) Using the hydrodynamic equations in (b), calculate dH°/dt. 

(f) Discuss the implications of the result in (e) for approach to equilibrium. 
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. Viscosity: consider a classical gas between two plates separated by a distance w. One 
plate at y= 0 is stationary, while the other at y= w moves with a constant velocity 
v, =u. A zeroth-order approximation to the one-particle density is 

23 n 
Sf. (B. @) = ————5 xP l-sact (p, — may)? +P; +p: , 
; (2amk,T)°” 2mk,T (, y+ P:) 


obtained from the uniform Maxwell—Boltzmann distribution by substituting the average 
value of the velocity at each point. (a = u/w is the velocity gradient.) 


(a) The above approximation does not satisfy the Boltzmann equation as the collision 
term vanishes, while df?/dt 4 0. Find a better approximation, f/(p), by linearizing 
the Boltzmann equation, in the single collision time approximation, to 


a p a if 
clil~[2+2 ]e~ _—* 


m oq Ty 


where 7,, is a characteristic mean time between collisions. 
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(b) Calculate the net transfer II,, of the x component of the momentum, of particles 


passing through a plane at y, per unit area and in unit time. 


(c) Note that the answer to (b) is independent of y, indicating a uniform transverse 


force F, = —II,,, exerted by the gas on each plate. Find the coefficient of viscosity, 


defined by = F,/a. 
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10. Light and matter: in this problem we use kinetic theory to explore the equilibrium 


between atoms and radiation. 


(a) 


(b) 


(c) 
(d) 


(e) 


The atoms are assumed to be either in their ground state ay, or in an excited state 
a,, which has a higher energy ¢. By considering the atoms as a collection of N 
fixed two-state systems of energy E (i.e., ignoring their coordinates and momenta), 
calculate the ratio n,/no of densities of atoms in the two states as a function of 
temperature T. 

Consider photons y of frequency # = ¢/h and momentum |p| = hw/c, which can 
interact with the atoms through the following processes: 


(i) Spontaneous emission: a, > ay +y. 
(ii) Adsorption: ay +y —> ay. 
(iii) Stimulated emission: a,+y—> dg +y+y. 


Assume that spontaneous emission occurs with a probability o,,, and that adsorption 
and stimulated emission have constant (angle-independent) differential cross-sections 
of 0,q/47 and o,,/477, respectively. 

Write down the Boltzmann equation governing the density f of the photon gas, 
treating the atoms as fixed scatterers of densities n) and n,. 

Find the equilibrium density /, for the photons of the above frequency. 
According to Planck’s law, the density of photons at a temperature T depends on 
their frequency w as f,, = [exp (hw/k,T) — 1]-' /h3. What does this imply about 
the above cross-sections? 

Consider a situation in which light shines along the x axis on a collection of atoms 
whose boundary coincides with the x = 0 plane, as illustrated in the figure. 


sy 


vacuum matter (1g, ,) 


Clearly, f will depend on x (and p,), but will be independent of y and z. Adapt the 
Boltzmann equation you propose in part (b) to the case of a uniform incoming flux 


11. 


12. 


13. 


Problems 


of photons with momentum p = hwX/c. What is the penetration length across which 
the incoming flux decays? 
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Equilibrium density: consider a gas of N particles of mass m, in an external potential 
U(q). Assume that the one-body density p, (p, q t) satisfies the Boltzmann equation. 
For a stationary solution, dp, /dt = 0, it is sufficient from Liouville’s theorem for p, to 
satisfy p, « exp [-B (p? /2m+ U(q))]- Prove that this condition is also necessary by 
using the H-theorem as follows. 


(a) Find p, (p,q) that minimizes H = N f d*pd*qp, (p, g) Inp,(p, g), subject to the 
constraint that the total energy E = (A) is constant. (Hint. Use the method of 
Lagrange multipliers to impose the constraint.) 

(b) For a mixture of two gases (particles of masses m, and m,) find the distributions 
p\” and p\” that minimize H =H“ +H subject to the constraint of constant total 
energy. Hence show that the kinetic energy per particle can serve as an empirical 


temperature. 
HE KK 2K 


Moments of momentum: consider a gas of N classical particles of mass m in thermal 
equilibrium at a temperature T, in a box of volume V. 


(a) Write down the equilibrium one-particle density f,, (p,q), for coordinate q, and 
momentum Pp. 

(b) Calculate the joint characteristic function, (exp (-ik : )), for momentum. 

(c) Find all the joint cumulants (pi PY p?).. 


(d) Calculate the joint moment (p,,Pg (PP). 
yeloiieteisiok 


Generalized ideal gas: consider a gas of N particles confined to a box of volume V in 
d dimensions. The energy, €, and momentum, p, of each particle are related by € = p’, 
where p = |p|. (For classical particles s = 2, while for highly relativistic ones s = 1.) 
Let f(v)dv denote the probability of finding particles with speeds between v and v+dv, 
and n= N/V. 


(a) Calculate the number of impacts of gas molecules per unit area of the wall of the 
box, and per unit time as follows: 


(i) Show that the number of particles hitting area A in a time df arriving from a 
specific direction 0, with a speed v, is proportional to A - udtcos@ - nf(v)du, 
where @ is the angle between the direction Q and the normal to the wall. 


(ii) Summing over all directions © with the same polar angle 6, demonstrate that 


S,_, sin? 6 do 


dNM(6, v) =A - vdtcos@ - nf(v)dv - 5 
d 


where S$, = 274/? /(d/2 —1)! is the total solid angle in d dimensions. 
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14. 


(iii) By averaging over v and 6 show that 


N S, 
= | _ . nd, where a= | uf(v)dv is the average speed. 


Adt  (d—1)S, 


(b) Each (elastic) collision transfers a momentum 2p cos 6 to the wall. By examining the 
net force on an element of area prove that the pressure P equals = . g, where E is 
the average (kinetic) energy. (Note that the velocity v is not p/m but de/dp.) (Hint. 
Clearly, upon averaging over all directions (cos? 6) =1/d.) 


(c 


Neer 


Using thermodynamics and the result in (b), show that along an adiabatic curve PV” 
is constant, and calculate y. 

(d) According to the equipartition theorem, each degree of freedom that appears quadrat- 
ically in the energy has an energy kg7/2. Calculate the value of y if each gas particle 
has £ such quadratic degrees of freedom in addition to its translational motion. What 
values of y are expected for helium and hydrogen at room temperature? 


(e 


wm 


Consider the following experiment to test whether the motion of ants is random. 250 
ants are placed inside a 10cm x 10cm box. They cannot climb the wall, but can 
escape through an opening of size 5mm in the wall. If the motion of ants is indeed 
random, and they move with an average speed of 2mm s~!, how many are expected 
to escape the box in the first 30 seconds? 
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Effusion: a box contains a perfect gas at temperature T and density n. 


(a) What is the one-particle density, p,(v), for particles with velocity 0? 

A small hole is opened in the wall of the box for a short time to allow some particles 
to escape into a previously empty container. 

(b) During the time that the hole is open what is the flux (number of particles per unit 
time and per unit area) of particles into the container? (Ignore the possibility of any 
particles returning to the box.) 

(c) Show that the average kinetic energy of escaping particles is 2k,T. (Hint. Calculate 
contributions to kinetic energy of velocity components parallel and perpendicular to 
the wall separately.) 

(d) The hole is closed and the container (now thermally insulated) is allowed to reach 
equilibrium. What is the final temperature of the gas in the container? 

(e) A vessel partially filled with mercury (atomic weight 201), and closed except for 
a hole of area 0.1mm? above the liquid level, is kept at 0°C in a continuously 
evacuated enclosure. After 30 days it is found that 24mg of mercury has been lost. 
What is the vapor pressure of mercury at 0° C? 
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15. Adsorbed particles: consider a gas of classical particles of mass m in thermal equilibrium 


at a temperature 7, and with a density n. A clean metal surface is introduced into the 
gas. Particles hitting this surface with normal velocity less than v, are reflected back into 
the gas, while particles with normal velocity greater than v, are absorbed by it. 


(a) Find the average number of particles hitting one side of the surface per unit area and 
per unit time. 


16. 


Problems 


(b) Find the average number of particles absorbed by one side of the surface per unit 


area and per unit time. 
AO AO AK 


Electron emission: when a metal is heated in vacuum, electrons are emitted from its 
surface. The metal is modeled as a classical gas of non-interacting electrons held in the 
solid by an abrupt potential well of depth ¢ (the work-function) relative to the vacuum. 


(a) What is the relationship between the initial and final velocities of an escaping 
electron? 

(b) In thermal equilibrium at temperature T, what is the probability density function for 
the velocity of electrons? 

(c) If the number density of electrons is n, calculate the current density of thermally 


emitted electrons. 
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4 
Classical statistical mechanics 


4.1 General definitions 


Statistical mechanics is a probabilistic approach to equilibrium macroscopic 
properties of large numbers of degrees of freedom. 


As discussed in chapter |, equilibrium properties of macroscopic bodies are 
phenomenologically described by the laws of thermodynamics. The macrostate 
M depends on a relatively small number of thermodynamic coordinates. To 
provide a more fundamental derivation of these properties, we can examine 
the dynamics of the many degrees of freedom comprising a macroscopic body. 
Description of each microstate js requires an enormous amount of information, 
and the corresponding time evolution, governed by the Hamiltonian equations 
discussed in chapter 3, is usually quite complicated. Rather than following the 
evolution of an individual (pure) microstate, statistical mechanics examines an 
ensemble of microstates corresponding to a given (mixed) macrostate. It aims 
to provide the probabilities p,,(j) for the equilibrium ensemble. Liouville’s 
theorem justifies the assumption that all accessible microstates are equally likely 
in an equilibrium ensemble. As explained in chapter 2, such assignment of 
probabilities is subjective. In this chapter we shall provide unbiased estimates of 
Py) for a number of different equilibrium ensembles. A central conclusion is 
that in the thermodynamic limit, with large numbers of degrees of freedom, all 
these ensembles are in fact equivalent. In contrast to kinetic theory, equilibrium 
statistical mechanics leaves out the question of how various systems evolve to 
a state of equilibrium. 


4.2 The microcanonical ensemble 


Our starting point in thermodynamics is a mechanically and adiabatically 
isolated system. In the absence of heat or work input to the system, the 
internal energy F, and the generalized coordinates x, are fixed, specifying a 
macrostate M = (E,x). The corresponding set of mixed microstates form the 
microcanonical ensemble. In classical statistical mechanics, these microstates 


4.2 The microcanonical ensemble 


are defined by points in phase space, their time evolution governed by a Hamil- 
tonian F((w), as discussed in chapter 3. Since the Hamiltonian equations (3.1) 
conserve the total energy of a given system, all microstates are confined to 
the surface A(() = E in phase space. Let us assume that there are no other 
conserved quantities, so that all points on this surface are mutually accessible. 
The central postulate of statistical mechanics is that the equilibrium probability 
distribution is given by 


1 1 for H(w)=E 


——- 4.1 
QO(E,x) 10 otherwise aie 


P(E.x) (uw) = 
Some remarks and clarification are in order: 


(1) Boltzmann’s assumption of equal a priori equilibrium probabilities refers to the 
above postulate, which is in fact the unbiased probability estimate in phase 
space subject to the constraint of constant energy. This assignment is consis- 
tent with, but not required by, Liouville’s theorem. Note that the phase space 
specifying the microstates 2 must be composed of canonically conjugate pairs. 
Under a canonical change of variables,  — pm’, volumes in phase space are 
left invariant. The Jacobian of such transformations is unity, and the transformed 
probability, p(w’) = p(w) |du/du'|, is again uniform on the surface of constant 
energy. 


(2) The normalization factor Q(E,x) is the area of the surface of constant energy E in 
phase space. To avoid subtleties associated with densities that are non-zero only on 
a surface, it is sometimes more convenient to define the microcanonical ensemble by 
requiring E—A < H(w) < E+A, that is, constraining the energy of the ensemble up to 
an uncertainty of A. In this case, the accessible phase space forms a shell of thickness 
2A around the surface of energy E. The normalization is now the volume of the shell, 
Q/ = 2AQ. Since © typically depends exponentially on E, as long as A ~ O(E°) (or 
even O(E')), the difference between the surface and volume of the shell is negligible in 
the E «x N > oo limit, and we can use © and ©’ interchangeably. 


(3) The entropy of this uniform probability distribution is given by 


S(E, x) =k, In O(E, x). (4.2) 


An additional factor of kg is introduced compared with the definition of Eq. (2.70), 
so that the entropy has the correct dimensions of energy per degree Kelvin, used in 
thermodynamics. © and S are not changed by a canonical change of coordinates in phase 
space. For a collection of independent systems, the overall allowed phase space is the 
product of individual ones, that is, Oro.) = []; 0;. The resulting entropy is thus additive, 
as expected for an extensive quantity. 


Various results in thermodynamics now follow from Eq. (4.1), provided that 
we consider macroscopic systems with many degrees of freedom. 
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Fig. 4.1 The exchange of 
energy between two 
isolated systems. 


Fig. 4.2 The joint number 
of states of two systems 
in contact is 
overwhelmingly larger at 
the “equilibrium” 
energies Ey and E>. 


Classical statistical mechanics 


E E)=E-E, 


The zeroth law: equilibrium properties are discussed in thermodynamics 
by placing two previously isolated systems in contact, and allowing them to 
exchange heat. We can similarly bring together two microcanonical systems, 
and allow them to exchange energy, but not work. If the original systems have 
energies E, and E,, respectively, the combined system has energy EF = E, + E,. 
Assuming that interactions between the two parts are small, each microstate of 
the joint system corresponds to a pair of microstates of the two components, 
that is, w=, @ Mo, and H (pw, @p.) = H,(w,) +A (p>). As the joint system 
is in a microcanonical ensemble of energy EF = E, + E,, in equilibrium 


1 {' for H(m,)+ Hy (u2) = E 


a (4.3) 


Pe(M @ My) = 
0 otherwise 


Since only the overall energy is fixed, the total allowed phase space is computed 
from 


Q(B) = f dE,0,(E,)9,(E-£,) = f 4, exp | 


SE+SE-E)) ay 


kp 


> EF, 


The properties of the two systems in the new joint equilibrium state are implicit 
in Eq. (4.3). We can make them explicit by examining the entropy that follows 
from Eq. (4.4). Extensivity of entropy suggests that $, and S, are proportional 
to the numbers of particles in each system, making the integrand in Eq. (4.4) an 
exponentially large quantity. Hence the integral can be equated by the saddle 
point method to the maximum value of the integrand, obtained for energies Ey 
and E> = E— E*, that is, 


S(E) = ky In Q(E) © S,(E%) + S,(E%). (4.5) 


4.2 The microcanonical ensemble 


The position of the maximum is obtained by extremizing the exponent in 
Eq. (4.4) with respect to E,, resulting in the condition 
aS;| _ aS>| 


= 4.6 
JE\|,, E> mo) 


X2 

Although all joint microstates are equally likely, the above results indicate 
that there is an exponentially larger number of states in the vicinity of (Ey, E>). 
Originally, the joint system starts in the vicinity of some point (E?, E$). After 
the exchange of energy takes place, the combined system explores a whole 
set of new microstates. The probabilistic arguments provide no information 
on the dynamics of evolution amongst these microstates, or on the amount 
of time needed to establish equilibrium. However, once sufficient time has 
elapsed so that the assumption of equal a priori probabilities is again valid, the 
system is overwhelmingly likely to be at a state with internal energies (E7, E5). 
At this equilibrium point, condition (4.6) is satisfied, specifying a relation 
between two functions of state. These state functions are thus equivalent to 
empirical temperatures, and, indeed, consistent with the fundamental result of 
thermodynamics, we have 


os 
OE 


= (4.7) 


The first law: we next inquire about the variations of S(E,x) with x, by 
changing the coordinates reversibly by 6x. This results in doing work on 
the system by an amount dW = J- 6x, which changes the internal energy to 
E+J-6x. The first-order change in entropy is given by 


CRY CRY 
5E a —_ 


BS = S(E-+I-3x, x4 58) ~S(E.x) = ( - 
x 


) 8x. (4.8) 


This change will occur spontaneously, taking the system into a more probable 
state, unless the quantity in brackets is zero. Using Eq. (4.7), this allows us to 
identify the derivatives 


a 


=-=, (4.9) 
Ox; lB.x jj T 
Having thus identified all variations of S, we have 
dE -d 
as(e,x) =F - 2, —>» dE=TdS+J-dx, (4.10) 


allowing us to identify the heat input dQ = TdS. 

The second law: clearly, the above statistical definition of equilibrium rests 
on the presence of many degrees of freedom N > 1, which make it expo- 
nentially unlikely in N that the combined systems are found with component 
energies different from (E}, E>). By this construction, the equilibrium point 
has a larger number of accessible states than any starting point, that is, 


0, (Ef, X1) On (E5, &) = 04 (EF), X&))O (Ed, X). (4.11) 
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In the process of evolving to the more likely (and more densely populated) 
regions, there is an irreversible loss of information, accompanied by an increase 
in entropy, 


6S = S\(E}) + S,(E3) — S\(E,) — S,(Ey) = 0, (4.12) 


as required by the second law of thermodynamics. When the two bodies are 
first brought into contact, the equality in Eq. (4.6) does not hold. The change 


in entropy is such that 
1 7, T. ee . 


as, 
6S = | — 
: ( aE, 

that is, heat (energy) flows from the hotter to the colder body, as in Clausius’s 
statement of the second law. 


aS; 
aE, 


XI 


Stability conditions: since the point (Ey, E53) is a maximum, the second 
derivative of S,(E,)+S,(E,) must be negative at this point, that is, 

aS; 0S, 

JE? JE: 


<0. (4.14) 


X| XQ 
Applying the above condition to two parts of the same system, the condition of 
thermal stability, C, > 0, as discussed in Section 1.9, is regained. Similarly, the 
second-order changes in Eq. (4.8) must be negative, requiring that the matrtix 


#S/dx\dx;| , be positive definite. 


4.3 Two-level systems 


Consider N impurity atoms trapped in a solid matrix. Each impurity can be 
in one of two states, with energies 0 and e, respectively. This example is 
somewhat different from the situations considered so far, in that the allowed 
microstates are discrete. Liouville’s theorem applies to Hamiltonian evolution 
in a continuous phase space. Although there is less ambiguity in enumeration 
of discrete states, the dynamics that ensures that all allowed microstates are 
equally accessed will remain unspecified for the moment. (An example from 
quantum mechanical evolution will be presented later on.) 

The microstates of the two-level system are specified by the set of occupation 
numbers {n;}, where n; = 0 or 1 depending on whether the ith impurity is in 
its ground state or excited. The overall energy is 

N 
KH ({n;}) =€)> n,; = €N, (4.15) 
i=1 
where N, is the total number of excited impurities. The macrostate is specified 
by the total energy E, and the number of impurities N. The microcanonical 
probability is thus 


p ({n;}) = (4.16) 


——— 6 
O(E, N) €>o; nj, E. 


4.3 Two-level systems 


As there are N, = E/e excited impurities, the normalization is the number 
of ways of choosing N, excited levels among the available N, and given by 
the binomial coefficient 


N! 
1) ————————r (4.17) 
N,!(N—N,)! 
The entropy 
S(E,N kel al 4.18 
(E,N) =kgln NI(N—N,)! (4.18) 
can be simplified by Stirling’s formula in the limit of N,, N > 1 to 
N— _ 
S(E, N) © —Nky ig Sigg 
N N N N 
(4.19) 
Wel = lin > bl i i 
~ Pl \ Ne Ne Ne Ne} |" 
The equilibrium temperature can now be calculated from Eq. (4.7) as 
1 0 k E 
=F) ig . (4.20) 
T dE ly € Ne—E 
Ey 
EN |-secshestesersessesaacesesreesdeset deen ets 
(negative temperatures) 
EN/2 [ooneenn nner renee concen eee ee 
ek ,T 
0 i 
Alternatively, the internal energy at a temperature T is given by 
Ne 
5 (4.21) 


exp (ez) +1 

The internal energy is a monotonic function of temperature, increasing from 
a minimum value of 0 at T =O to a maximum value of Ne/2 at infinite 
temperature. It is, however, possible to start with energies larger than Ne/2, 
which correspond to negative temperatures from Eq. (4.20). The origin of 
the negative temperature is the decrease in the number of microstates with 
increasing energy, the opposite of what happens in most systems. Two-level 
systems have an upper bound on their energy, and very few microstates close to 
this maximal energy. Hence, increased energy leads to more order in the system. 
However, once a negative temperature system is brought into contact with the 


Fig. 4.3 The internal 
energy of a two-level 
system, as a function of 
its temperature T. 
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Fig. 4.4 The heat capacity 


of a two-level system 
goes to zero at both high 
and low temperatures T. 


Fig. 4.5 The probabilities 
for finding a single 
impurity in its ground 
state (top), or excited 
state (bottom), as a 
function of 

temperature T. 
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rest of the Universe (or any portion of it without an upper bound in energy), it 
loses its excess energy and comes to equilibrium at a positive temperature. The 
world of negative temperatures is quite unusual in that systems can be cooled by 
adding heat, and heated by removing it. There are physical examples of systems 
temporarily prepared at a metastable equilibrium of negative temperature in 
lasers, and for magnetic spins. 

The heat capacity of the system, given by 


>) 


Nk € 2 € € 41 . 
—— eX enema eX =e 
ET) PNET) |! eer 


_ dE 


== (4.22) 


Cc 


(€/2k pT) 


0 elkp T 


vanishes at both low and high temperatures. The vanishing of C as 
exp(—€/k,T) at low temperatures is characteristic of all systems with an 
energy gap separating the ground state and lowest excited states. The vanishing 
of C at high temperatures is a saturation effect, common to systems with a 
maximum in the number of states as a function of energy. In between, the heat 
capacity exhibits a peak at a characteristic temperature of T, « €/Kp. 


1/2 


Statistical mechanics provides much more than just macroscopic information 
for quantities such as energy and heat capacity. Equation (4.16) is a complete 
joint probability distribution with considerable information on the microstates. 
For example, the unconditional probability for exciting a particular impurity is 
obtained from 
O(E—n,e,N—-1) 


vee (4.23) 


Ey P({n;}) = 


{ng,-- ny} 


p(n) = 


4.4 The ideal gas 


The second equality is obtained by noting that once the energy taken by the 

first impurity is specified, the remaining energy must be distributed among the 

other N — 1 impurities. Using Eq. (4.17), 

Q(E,N-1)_ (N-D)! N,!(N—N,)! 
Q(E,N) ~ N,!(N—N,—1)! N! 

and p(n, = 1) =1—p(n, =0)=N,/N. Using N, = E/e, and Eq. (4.21), the 

occupation probabilities at a temperature T are 


N, 
=1 5 
N 


p(m, =0) = (4.24) 


_exp(-ar) (4.25) 


1 
eee). and eee ars 


4.4 The ideal gas 


As discussed in chapter 3, microstates of a gas of N particles correspond to 
points w= {B;. qi in the 6N-dimensional phase space. Ignoring the potential 
energy of interactions, the particles are subject to a Hamiltonian 


H= X [Fe + U(G) |: (4.26) 


where U(q) describes the potential imposed by a box of volume V. A micro- 
canonical ensemble is specified by its energy, volume, and number of particles, 
M = (E, V, N). The joint PDF for a microstate is 


(4.27) 


1 1 for g;€ box, and 7; p;7/2m=E (+A,;) 
p(w) = 


Q(E, V, N ) 0 otherwise 


In the allowed microstates, coordinates of the particles must be within the 
box, while the momenta are constrained to the surface of the (hyper-)sphere 
>= | P;? = 2mE. The allowed phase space is thus the product of a contribution 
V™ from the coordinates, with the surface area of a 3N-dimensional sphere of 
radius /2mE from the momenta. (If the microstate energies are accepted in 
the energy interval E+ A,,, the corresponding volume in momentum space is 
that of a (hyper-)spherical shell of thickness Ap = ./2m/EAE.) The area of a 
d-dimensional sphere is A, = S,R4~', where S, is the generalized solid angle. 

A simple way to calculate the d-dimensional solid angle is to consider the 
product of d Gaussian integrals, 


foe) > d 
L= ( [ axe") = 74/2, (4.28) 


Alternatively, we may consider J, as an integral over the entire d-dimensional 
space, that is, 


l= | Pideess (x), (4.29) 
i=1 
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The integrand is spherically symmetric, and we can change coordinates to 
R? = 9°; x7. Noting that the corresponding volume element in these coordinates 
is dV, = S,R* dR, 


me 2 ~=6S§, ve S 
— d-1,_-R° ae d/2-le-y — aa —1)! 
i [ dRS,Rte ; [ dyy4/-le 5 4/2-1), (4.30) 
where we have first made a change of variables to y = R?, and then used the 


integral representation of n! in Eq. (2.63). Equating expressions (4.28) and 
(4.30) for I, gives the final result for the solid angle, 


Qd/2 
!-Gpaspt (4.31) 
The volume of the available phase space is thus given by 
yw 20? (N-1)/2 


The entropy is obtained from the logarithm of the above expression. Using 
Stirling’s formula, and neglecting terms of order of 1 or InE ~ InN in the 
large N limit, results in 


3N 3N. 3N 3N 
S(E, V,N) = kp [inv +5 inamme) — — In — + — 


2 2 2, 
AmemE \*” 
= NkgIn| V ‘ 
3N 


Properties of the ideal gas can now be recovered from TdS = dE+ PdV — pwd, 


(4.33) 


1 aS! 3 Nk, 


= = (4.34) 
T @Elyy 2 E 


The internal energy E = 3Nk,T/2 is only a function of T, and the heat capacity 
Cy = 3Nk,/2 is a constant. The equation of state is obtained from 
P_ as 
T av 


Nk 
=—32, => PV=Nk,T. (4.35) 
NE V 


The unconditional probability of finding a particle of momentum p, in the 
gas can be calculated from the joint PDF in Eq. (4.27), by integrating over all 
other variables, 


N 

rp) =/ PH TGA Pra Bp) 
i=2 

(4.36) 


uw V O(E— p,?/2m, V, N-1) 
~ Q(E, V, N) 


4.5 Mixing entropy and the Gibbs paradox 


The final expression indicates that once the kinetic energy of one particle is 
specified, the remaining energy must be shared amongst the other N — 1. Using 
Eq. (4.32), 


VN O-D? (2mE — p,?)SX-9? (3N/2—1)! 
(3(N —1)/2-1)! VN 73/2 (2mE)GBN-D/2 


P(Pi) = 
(4.37) 


7 i | (3N/2—1)! 
=( p-) (2mmE)*/? (3(N —1)/2—1)! 


From Stirling’s formula, the ratio of (3N/2—1)! to (3(N —1)/2— 1)! is approx- 
imately (3N/2)*/7, and in the large E limit, 


: 3n \3? 3N D,2 
_ meee 4.38 
P(Pi) (=) exo ( 2 f) Ce38) 


This is a properly normalized Maxwell—Boltzmann distribution, which can be 
displayed in its more familiar form after the substitution E = 3Nk,T/2, 


- 1 Bi? 
= 4.39 
PP.) = Gamk, FR OP ( | 9?) 


4.5 Mixing entropy and the Gibbs paradox 


The expression in Eq. (4.33) for the entropy of the ideal gas has a major 
shortcoming in that it is not extensive. Under the transformation (E, V, VN) > 
(AE, AV, AN), the entropy changes to A(S+ NkgInA). The additional term 
comes from the contribution V" of the coordinates to the available phase 
space. This difficulty is intimately related to the mixing entropy of two gases. 
Consider two distinct gases, initially occupying volumes V, and V, at the same 
temperature 7. The partition between them is removed, and they are allowed 
to expand and occupy the combined volume V = V, + V,. The mixing process 
is clearly irreversible, and must be accompanied by an increase in entropy, 
calculated as follows. According to Eq. (4.33), the initial entropy is 


S, =S,+S, = Nkg(InV, +0,)+N,k,(InV,+ 05), (4.40) 
where 
47em, E, a 
O»,=In -—< (4.41) 
3 Ny 


is the momentum contribution to the entropy of the ath gas. Since E/N, = 
3k,7/2 for a monotonic gas, 


0,(T) = ; In(27rem,kpT). (4.42) 


The temperature of the gas is unchanged by mixing, since 
3, E,tE, EF, E, 3 
5 2 NAN ON, ONG OD 


ey (4.43) 
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Fig. 4.6 A mixing entropy 
results from removing 
the partition separating 
two gases. 
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The final entropy of the mixed gas is 
Sp = Ni kg ln(V, + V2) + Nok In(V, + V2) + kg(Nio) + N05). (4.44) 

There is no change in the contribution from the momenta, which depends only 

on temperature. The mixing entropy, 

Vv 


V 
ASyix = Sp — S, = Nykg ln al Nykp In 2 


N N. 
edie 2 ty V2 
N V N V 


=—Nky | , (4.45) 


is solely from the contribution of the coordinates. The above expression 
is easily generalized to the mixing of many components, with AS, = 
—Nkz YValNa/N) In(V,/V). 


oa 


(N,V) (N>, V5) 


The Gibbs paradox is related to what happens when the two gases, initially 
on the two sides of the partition, are identical with the same density, n = 
N,/V, = Nz/V>. Since removing or inserting the partition does not change the 
state of the system, there should be no entropy of mixing, while Eq. (4.45) does 
predict such a change. For the resolution of this paradox, note that while after 
removing and reinserting the partition, the macroscopic system does return to its 
initial configuration, the actual particles that occupy the two chambers are not 
the same. But as the particles are by assumption identical, these configurations 
cannot be distinguished. In other words, while the exchange of distinct particles 
leads to two configurations 


e ° ° e 
——— and —-—_., 
A B 


a similar exchange has no effect on identical particles, as in 


e e e e 
—— and ——. 
A B A B 


Therefore, we have over-counted the phase space associated with N identical 
particles by the number of possible permutations. As there are N! permutations 
leading to indistinguishable microstates, Eq. (4.32) should be corrected to 


yn A 73N/2 


OW, EV) = 57 Gna) 


(2mE)SX-YPA,, (4.46) 


4.5 Mixing entropy and the Gibbs paradox 


resulting in a modified entropy, 
V 
S=kznQ=k,[NInV—NInN+NIne]+Nkgo = Nk, in +o| . (4.47) 


As the argument of the logarithm has changed from V to V/N, the final 
expression is now properly extensive. The mixing entropies can be recalculated 
using Eq. (4.47). For the mixing of distinct gases, 


V V V V. 
ASwix = Sp — 8; = Nikg in N, +Nykgln Ni Nikgln N, Nykg ln Ni, 
Nidal. = encanta 4.48 
— n{j—-:-— nit—-:-— 2 
aa OH ake ln ey, (4.48) 
No Vi My. V, 
= —Nk,| —In—+—In—], 
VN Vv 


exactly as obtained before in Eq. (4.45). For the “mixing” of two identical 
gases, with N,/V, = N/V, = (N, + N,)/(V, + Vo), 


2 
N,k,z In — = 0. 4.49 
N, EN ( ) 


V, 
ASwix = Sp — S; = (N; + Np) kg In ~—N,kgln 
Mix f i ( 1 >) B N +4 Ny 1“B 
Note that after taking the permutations of identical particles into account, the 
available coordinate volume in the final state is V“!+*?/N,!N,! for distinct 
particles, and V™'+"2/(N, + N,)! for identical particles. 
Additional comments on the microcanonical entropy: 


1. In the example of two-level impurities in a solid matrix (Section 4.3), there is no 
need for the additional factor of N!, as the defects can be distinguished by their 
locations. 

2. The corrected formula for the ideal gas entropy in Eq. (4.47) does not affect the 
computations of energy and pressure in Eqs. (4.34) and (4.35). It is essential to 


obtaining an intensive chemical potential, 


a AamE \*!” 
Be |) Seale) Ak (4.50) 
T ON|py  N 2 N\ 3N 


3. The above treatment of identical particles is somewhat artificial. This is because the 
concept of identical particles does not easily fit within the framework of classical 
mechanics. To implement the Hamiltonian equations of motion on a computer, 
one has to keep track of the coordinates of the N particles. The computer will 
have no difficulty in distinguishing exchanged particles. The indistinguishability 
of their phase spaces is in a sense an additional postulate of classical statistical 
mechanics. This problem is elegantly resolved within the framework of quantum 
statistical mechanics. Description of identical particles in quantum mechanics requires 
proper symmetrization of the wave function. The corresponding quantum microstates 


naturally yield the N! factor, as will be shown later on. 


109 


110 


Fig. 4.7 The system S can 
be maintained at a 
temperature 7 through 
heat exchanges with the 
reservoir R. 
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4. Yet another difficulty with the expression (4.47), resolved in quantum statistical 
mechanics, is the arbitrary constant that appears in changing the units of measurement 
for q and p. The volume of phase space involves products pg, of coordinates and 
conjugate momenta, and hence has dimensions of (action)”. Quantum mechanics 
provides the appropriate measure of action in Planck’s constant h. Anticipating these 
quantum results, we shall henceforth set the measure of phase space for identical 


particles to 


Laie ae 
aly = Fay Le dD, (4.51) 


4.6 The canonical ensemble 


In the microcanonical ensemble, the energy EF of a large macroscopic system is 
precisely specified, and its equilibrium temperature T emerges as a consequence 
(Eq. (4.7)). However, from a thermodynamic perspective, E and T are both 
functions of state and on the same footing. It is possible to construct a statistical 
mechanical formulation in which the temperature of the system is specified 
and its internal energy is then deduced. This is achieved in the canonical 
ensemble where the macrostates, specified by M = (T,x), allow the input of 
heat into the system, but no external work. The system S is maintained at 
a constant temperature through contact with a reservoir R. The reservoir is 
another macroscopic system that is sufficiently large so that its temperature 
is not changed due to interactions with S. To find the probabilities p(7,)(“) 
of the various microstates of S, note that the combined system R ®S belongs 
to a microcanonical ensemble of energy Ey, >> Es. As in Eq. (4.3), the joint 
probability of microstates (j1g ® Mp) is 


1 : for Hs(Ms) + Hp (Me) = Ero 


P(Hs @ HR) = >——— 
? = Oger (Egor) 


(4.52) 


0 otherwise 


The unconditional probability for microstates of S is now obtained from 


P(Ms) = >» P(Ms @ Mp). (4.53) 


{ur} 


4.6 The canonical ensemble 


Once jg is specified, the above sum is restricted to microstates of the reservoir 
with energy Ey,, — A s(s). The number of such states is related to the entropy 
of the reservoir, and leads to 


OR (Eo —-Hs (us) 
Oger (Error) 


Since, by assumption, the energy of the system is insignificant compared with 
that of the reservoir, 


Pls) = exp] PSe(Er—Ms(us)) | (454) 


as; H s(us) 

Sp (Erot _ Hs(us)) % Sr (Eto) — Hs (Ms) ae = Sp (Eto) — oa ae . (4.55) 
R 
Dropping the subscript S, the normalized probabilities are given by 
e BH (u) 
Porxy (PH) = Z(T,x) | (4.56) 
The normalization 

Z(T,x) = Ye PEW (4.57) 


{u} 


is known as the partition function, and B = 1/k,T. (Note that probabilities 
similar to Eq. (4.56) were already obtained in Eqs. (4.25) and (4.39), when 
considering a portion of the system in equilibrium with the rest of it.) 

Is the internal energy E of the system S well defined? Unlike in a micro- 
canonical ensemble, the energy of a system exchanging heat with a reservoir 
is a random variable. Its probability distribution p(€) is obtained by changing 
variables from pe to A (2) in p(w), resulting in 


pe 
rE) =D p(w) 8 (Hw) —€) = Yo(Hw)-€). (4.58) 
{n} {n} 


Since the restricted sum is just the number ((E€) of microstates of appropriate 
energy, 


(4.59) 


O(E)eFE exp] E |- lL .. ro 


é€)= = 
pé) Z Z kp eT| Z kT 


where we have set F = € — TS(E), in anticipation of its relation to the Helmholtz 
free energy. The probability p(€) is sharply peaked at a most probable energy 
E*, which minimizes F(€). Using the result in Section 3.6 for sums over 
exponentials, 


Z=y0 eH) — ye bre ) = @BRE*) (4.60) 
{nu} é 
The average energy computed from the distribution in Eq. (4.59) is 


ebH (we) 1a eb __ alnZ (461) 
Z Z OB ap” : 


(H) =D H() 
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Fig. 4.8 The probability 
distribution of the internal 
energy for a system ina 
canonical ensemble at a 
temperature T. 
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ple) 4 


In thermodynamics, a similar expression was encountered for the energy 
(Eq. (1.37)), 


aF a (F\ AF) 
E=F+TS=F-T =-T° = 4.62 
-e I = (7) ap oie 
Equations (4.60) and (4.61) both suggest identifying 
F(T, x) = —kyT In Z(T,x). (4.63) 


However, note that Eq. (4.60) refers to the most likely energy, while the average 
energy appears in Eq. (4.61). How close are these two values of the energy? We 
can get an idea of the width of the probability distribution p(€), by computing 
the variance (#(*)... This is most easily accomplished by noting that Z(B) is 
related to the characteristic function for A (with B replacing ik) and 


OZ PZ 
~“=y Heh, and “Cay He PX, (4.64) 
ap ~ ape = 
Cumulants of H are generated by In Z(B), 
1 10Z dlnZ 
ay ee See ek 4. 
(W)= ZEKE ap ap (4.65) 


and 


(0) = (90) — (HP = FEI. (ake) _#inZ _ Hy 


ap2 iC 
(4.66) 
More generally, the nth cumulant of FH is given by 
: a inZ 
(H"). =(-1) ap (4.67) 
From Eq. (4.66), 
d(H) HH) | 
IC) = =k,T? ca es sv ie 4, 
(\.= sa shel | em bTC, (4.68) 


where we have identified the heat capacity with the thermal derivative of the 
average energy (FC). Equation (4.68) shows that it is justified to treat the mean 
and most likely energies interchangeably, since the width of the distribution 


4.7 Canonical examples 


Table 4.1 Comparison of canonical and microcanonical ensembles 


Ensemble Macrostate P(L) Normalization 
Microcanonical (E,x) on (H(u) - E)/O S(E, x) =k,InQ, 
Canonical (T, x) exp (— BH (u))/Z F(T, x) = —k,TInZ 


p(€) only grows as ,/(H). « N'?. The relative error, ,/(H)./(H),, van- 
ishes in the thermodynamic limit as 1/./N. (In fact, Eq. (4.67) shows that all 
cumulants of AC are proportional to N.) The PDF for energy in a canonical 
ensemble can thus be approximated by 


1 (E— (5)? 1 
€)=-e pré) ex ( ; 4.69 
Ma 7 PM 2k T?C, ) JimkgT2C, So 


The above distribution is sufficiently sharp to make the internal energy in a 
canonical ensemble unambiguous in the N — oo limit. Some care is necessary 
if the heat capacity C, is divergent, as is the case in some continuous phase 
transitions. 

The canonical probabilities in Eq. (4.56) are unbiased estimates obtained 
(as in Section 2.7) by constraining the average energy. The entropy of the 
canonical ensemble can also be calculated directly from Eq. (4.56) (using 
Eq. (2.68)) as 

E-F 

S = ky (In p()) = ~ky (“BH —InZ)) = ——, (4.70) 
again using the identification of InZ with the free energy from Eq. (4.63). 
For any finite system, the canonical and microcanonical properties are dis- 
tinct. However, in the so-called thermodynamic limit of N — oo, the canon- 
ical energy probability is so sharply peaked around the average energy that 
the ensemble becomes essentially indistinguishable from the microcanonical 
ensemble at that energy. Table 4.1 compares the prescriptions used in the two 
ensembles. 


4.7 Canonical examples 


The two examples of Sections 4.3 and 4.4 are now re-examined in the canonical 
ensemble. 

(1) Two-level systems: the N impurities are described by a macrostate M = 
(T, N). Subject to the Hamiltonian HH = € Es n,, the canonical probabilities 
of the microstates w = {n;} are given by 


P({n;}) = FOP [263m]. (4.71) 
i=l 
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From the partition function, 


Z(T, N) =) exp [663 = (x om) he ( > em) 


{nj} i=l n,=0 ny=0 (4.72) 
= (1 + en" ‘ 
we obtain the free energy 
F(T, N) = —kgT InZ = —NkgT In[{1+e “8” ]. (4.73) 
The entropy is now given by 
ace ~€/(ksT ) é eet) 
SSS 55 v= Mele ]+NkgT iF) pet)’ (4.74) 
F/T 
The internal energy, 
ee 4.75 
ae 1tec/(ksT) ’ Cy) 
can also be obtained from 
dInZ Nee 
Sees (4.76) 


dB 1 +e-Be" 
Since the joint probability in Eq. (4.71) is in the form of a product, p =|]; p;, 
the excitations of different impurities are independent of each other, with the 
unconditional probabilities 
e-Ben; 
This result coincides with Eqs. (4.25), obtained through a more elaborate 
analysis in the microcanonical ensemble. As expected, in the large N limit, the 


p(n;) = (4.77) 


canonical and microcanonical ensembles describe exactly the same physics, 
both at the macroscopic and microscopic levels. 

(2) The ideal gas: for the canonical macrostate M = (T, V, N), the joint PDF 
for the microstates w = {p,, q;} is 


a 1 \ p 1 for {g,} € box 
PULP: Gi}) = F EXP [0x | | (4.78) 
i 0 otherwise 


Including the modifications to the phase space of identical particles in 
Eq. (4.51), the dimensionless partition function is computed as 


1 © d?q,d°p; De 
Z(F, V,N)= | —T]— "exp | -8 
‘j=l 


_VN (2amkgT\"? 1 ( Vv \™ 
~ N! h2 ~ NELACT)B ’ 


(4.79) 


where 


(4.80) 


4.8 The Gibbs canonical ensemble 


is a characteristic length associated with the action h. It shall be demonstrated 
later on that this length scale controls the onset of quantum mechanical effects 
in an ideal gas. 

The free energy is given by 


3N 27mk pT 
F =—kgT InZ = —NkgT nV + NkgT InN — NkagT — “gy Sat in —— 


Ve\ 3. (2amk,T 
= —Nkgt {in (7°) + Fn ( ae )}. (4.81) 


Various thermodynamic properties of the ideal gas can now be obtained from 
dF = —SdT — PdV + wdN. For example, from the entropy 


aF Ve 3. (2amk,T a Fak 
aS) See. 1 Nk,T — = , (4.82 
aT ly y pm +5In( ie )] Topp 48) 


we obtain the internal energy E = 3Nk,T/2. The equation of state is obtained 
from 


aF NkgT 
P= = —_ = , = PV=M,T, 4.83 
ea : (4.83) 
and the chemical potential is given by 
aF F E-TS+PV ; 
= — = —+k,T = ———— =k,Tln(nd°). 4.84 
fag aN - WN +Kp N pf in (n ) ( ) 


Also, according to Eq. (4.78), the momenta of the N particles are taken from 
independent Maxwell—Boltzmann distributions, consistent with Eq. (4.39). 


4.8 The Gibbs canonical ensemble 


We can also define a generalized canonical ensemble in which the internal 
energy changes by the addition of both heat and work. The macrostates M = 
(T, J) are specified in terms of the external temperature and forces acting 
on the system; the thermodynamic coordinates x appear as additional random 
variables. The system is maintained at constant force through external elements 
(e.g., pistons or magnets). Including the work done against the forces, the energy 
of the combined system that includes these elements is HH — J-x. Note that 
while the work done on the system is +J-x, the energy change associated with 
the external elements with coordinates x has the opposite sign. The microstates 
of this combined system occur with the (canonical) probabilities 


P(Ms, x) = exp[—BH (us) + BS-x]/2(7, N, J), (4.85) 
with the Gibbs partition function 
Z(N, TJ) = Yo ex PH ts) | (4.86) 
Ms.X 
(Note that we have explicitly included the particle number N to emphasize that 


there is no chemical work. Chemical work is considered in the grand canonical 
ensemble, which is discussed next.) 
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Fig. 4.9 A system in 
contact with a reservoir 
at temperature 7, and 
maintained at a fixed 
force J. 


Classical statistical mechanics 


(x, E) (J, T) 


WM — 


H, HCL) 


In this ensemble, the expectation value of the coordinates is obtained from 
diInZ 
, 4.87 
a (4.87) 
which together with the thermodynamic identity x = —dG/oJ, suggests the 
identification 


(x) = kpT —— 


G(N, T, J) = —k,TInZ, (4.88) 


where G = E—TS—x-J is the Gibbs free energy. (The same conclusion can be 
reached by equating Z in Eq. (4.86) to the term that maximizes the probability 
with respect to x.) The enthalpy H = E—x-J is easily obtained in this ensemble 
from 


=(H —-x-J) =H. (4.89) 


Note that heat capacities at constant force (which include work done against 
the external forces) are obtained from the enthalpy as Cy = 0H/0T. 
The following examples illustrate the use of the Gibbs canonical ensemble. 
(1) The ideal gas in the isobaric ensemble is described by the macrostate 
= (N,T, P). A microstate uw = {p;, q;}, with a volume V, occurs with the 
probability 


1 for {g;} € box of volume V 


PULP; i} V) = pe| pee aev || 


0 otherwise 


(4.90) 


The normalization factor is now 


2(N, T, P) = [ave mv f eT ex P| 0d | _ 


eo 1 1 
= dVV™ e-BPVv = . 
i vv oN ~ (apy acre 


Ignoring non-extensive contributions, the Gibbs free energy is given by 


5 3 he 
G=—k,TInZ © NkgT | InP— ~In(kgT)+~— In (4.92) 
5 2 \2am 


Starting from dG = —SdT + VdP+ wd, the volume of the gas is obtained as 
_ aG| _ NkgT 
AP NP 


: => PV=NK,T. (4.93) 


4.8 The Gibbs canonical ensemble 


(P,T) 


(V, E) 


The enthalpy H = (E+ PV) is easily calculated from 


dnz 5 
er aa 5 NkeT, 
from which we get Cp, = dH/dT = 5/2Nk,. 

(2) Spins in an external magnetic field B provide a common example for 
usage of the Gibbs canonical ensemble. Adding the work done against the 
magnetic field to the internal Hamiltonian 7 results in the Gibbs partition 
function 


Z(N, T, B) = tr [exp (—69¢ + BB. in)| , 


where M is the net magnetization. The symbol “tr” is used to indicate the sum 
over all spin degrees of freedom, which in a quantum mechanical formulation 
are restricted to discrete values. The simplest case is spin of 1/2, with two pos- 
sible projections of the spin along the magnetic field. A microstate of N spins 
is now described by the set of Ising variables {o, = +1}. The corresponding 
magnetization along the field direction is given by M = py Ey o;, where [Ly 
is a microscopic magnetic moment. Assuming that there are no interactions 
between spins (#H = 0), the probability of a microstate is 


i=1 


p (tor) = 5 exp et 3 “| . (4.94) 
Clearly, this is closely related to the example of two-level systems discussed in 
the canonical ensemble, and we can easily obtain the Gibbs partition function 
Z(N, T, B) = [2cosh(BuyB)]" , (4.95) 
and the Gibbs free energy 
G = —k,T In Z = —Nk,T In[2 cosh(BuyB)]. (4.96) 
The average magnetization is given by 


aG 
M =——, = Njto tanh(ByoB). (4.97) 
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Fig. 4.10 In the isobaric 
ensemble, the gas in the 
piston is maintained at a 
pressure P. 
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Fig. 4.11 A system S, in 
contact with a reservoir 
R, of temperature T and 
chemical potential pw. 


Classical statistical mechanics 


Expanding Eq. (4.97) for small B results in the well-known Curie law for 


magnetic susceptibility of non-interacting spins, 
OM Nu 

T=) = 8. 

OBl yo kaT 


The enthalpy is simply H = (H — BM) = —BM, and C, = —BoM/O0T. 


(4.98) 


4.9 The grand canonical ensemble 


The previous sections demonstrate that while the canonical and microcanonical 
ensembles are completely equivalent in the thermodynamic limit, it is fre- 
quently easier to perform statistical mechanical computations in the canonical 
framework. Sometimes it is more convenient to allow chemical work (by fixing 
the chemical potential yz, rather than at a fixed number of particles), but no 
mechanical work. The resulting macrostates M = (T, w,x) are described by 
the grand canonical ensemble. The corresponding microstates jug contain an 
indefinite number of particles N(w,). As in the case of the canonical ensemble, 
the system S can be maintained at a constant chemical potential through contact 
with a reservoir R, at temperature T and chemical potential x. The probability 
distribution for the microstates of S is obtained by summing over all states of 
the reservoir, as in Eq. (4.53), and is given by 


P(Us) = exp [BUN(Us) — BH (us) /2.- (4.99) 


The normalization factor is the grand partition function, 


Q(T, b,x) = yo ebH Mus) BIE (us), (4.100) 


Ms 


We can reorganize the above summation by grouping together all microstates 
with a given number of particles, that is, 


O(T, ,x) = Yo PHN SD e PH wus), (4.101) 


N=0 (us|) 


4.9 The grand canonical ensemble 


The restricted sums in Eq. (4.101) are just the N-particle partition functions. 
As each term in Q is the total weight of all microstates of N particles, the 
unconditional probability of finding N particles in the system is 


_ eF#NZ(T, N,X) 


N)= 4.102 
NY) = OC asx) oe 
The average number of particles in the system is 
1 oO 0 
N)= Q= InQ, (4.103) 
= 3 Bm) HBu) 
while the number fluctuations are related to the variance 
1 & a ’ a(N) 
(N?) 0 = (N*) — (NY? = InQ ( ino) = -InQ= : 
cH Y= 9 Bue aw) Bue” = 3B) 
(4.104) 


The variance is thus proportional to N, and the relative number fluctuations 
vanish in the thermodynamic limit, establishing the equivalence of this ensem- 
ble to the previous ones. 
Because of the sharpness of the distribution for NV, the sum in Eq. (4.101) 
can be approximated by its largest term at N = N* ~ (N), that is, 
O(T, w,x) = lim )~ e?*"Z(T, N,x) = e8"""Z(T, N*, x) = ef HN" BF 
Nv v=o (4.105) 


= @A(-HN*+E-TS) _ 9-BS 


where 
G(T, uw, x) =E—TS—pN = —kgTInQ (4.106) 

is the grand potential. Thermodynamic information is obtained by using dg = 

—SdT —Nduw+J-dx, as 

_ 0g aG 

~ aT] Ou 


HX 


as (4.107) 


As a final example, we compute the properties of the ideal gas of non- 
interacting particles in the grand canonical ensemble. The macrostate is M = 
(T, », V), and the corresponding microstates {p,, 4), P>, >, °-* } have indefinite 
particle number. The grand partition function is given by 


oo 1 N 34,03 p, p 
= BLN i i > i 
VP V I= De al (i rs )oo| ‘ 


N=0 


0 eBuN af 
= (=) oe (4.108) 
woo N! \X JV 27mkgT 
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and the grand potential is 
Vv 
G(T, w, V) = —kgT In Q= ky Teh. (4.109) 


But, since G = E— TS — uN = —PV, the gas pressure can be obtained directly 
as 


P=-~-=-—| =k,T-—. (4.110) 
BT 


(4.111) 


The equation of state is obtained by comparing Eqs. (4.110) and (4.111), as 
P=k,TN/V. Finally, the chemical potential is given by 


N PM 
w=k,T In (“) =t7n(7), (4.112) 


B 


Problems for chapter 4 


1. Classical harmonic oscillators: consider N harmonic oscillators with coordinates and 


momenta {q;, p;}, and subject to a Hamiltonian 


~ E mee) 


KH ({q;, pi}) = » 


i=1 


(a) Calculate the entropy S, as a function of the total energy E. 
(Hint. By appropriate change of scale, the surface of constant energy can be deformed 
into a sphere. You may then ignore the difference between the surface area and 
volume for N >> 1. A more elegant method is to implement this deformation through 
a canonical transformation.) 

(b) Calculate the energy E, and heat capacity C, as functions of temperature T, and N. 

(c) Find the joint probability density P(p, q) for a single oscillator. Hence calculate the 


mean kinetic energy, and mean potential energy for each oscillator. 
Co eee 


2. Quantum harmonic oscillators: consider N independent quantum oscillators subject to a 


Hamiltonian 
. 1 
KH ({n;}) = do ho (x + 5) F 
i=l 
where n; = 0, 1, 2,--- is the quantum occupation number for the ith oscillator. 


(a) Calculate the entropy S, as a function of the total energy E. 
(Hint. O.(E) can be regarded as the number of ways of rearranging M = >; n; balls, 
and N — 1 partitions along a line.) 


Problems 


(b) Calculate the energy E, and heat capacity C, as functions of temperature T, and N. 
(c) Find the probability p(n) that a particular oscillator is in its nth quantum level. 
(d) Comment on the difference between heat capacities for classical and quantum oscil- 


lators. 


2k OK 2k ok ok 2k ok ok 


. Relativistic particles: N indistinguishable relativistic particles move in one dimension 


subject to a Hamiltonian 


N 
H ({P;, 4h) = Ve lelpil+ U4@)]. 
i=l 
with U(q;) = 0 for 0 < g, < L, and U(q;) = co otherwise. Consider a microcanonical 


ensemble of total energy E. 


(a) Compute the contribution of the coordinates g; to the available volume in phase space 
Q(E, L, N). 

(b) Compute the contribution of the momenta p; to O(E, L, N). 
(Hint. The volume of the hyperpyramid defined by 1, x, < R, and x, > 0, in d 
dimensions is R¢/d!.) 

(c) Compute the entropy S(E, L, N). 

(d) Calculate the one-dimensional pressure P. 

(e) Obtain the heat capacities C, and Cp. 

(f) What is the probability p(p,) of finding a particle with momentum p,? 


2K ok oko 2k ok ok 


. Hard sphere gas: consider a gas of N hard spheres in a box. A single sphere excludes 
a volume w around it, while its center of mass can explore a volume V (if the box is 
otherwise empty). There are no other interactions between the spheres, except for the 


constraints of hard-core exclusion. 


(a) Calculate the entropy S, as a function of the total energy E. 
(Hint. (V —aw)(V —(N —a)w) © (V— No/2)”.) 
(b) Calculate the equation of state of this gas. 
(c) Show that the isothermal compressibility, k; = —V~! dV/dP|,, is always positive. 


2k ok ok ok ok 2k ok ok 


. Non-harmonic gas: let us re-examine the generalized ideal gas introduced in the previous 
section, using statistical mechanics rather than kinetic theory. Consider a gas of N 


non-interacting atoms in a d-dimensional box of “volume” V, with a kinetic energy 


Ss 


> 


N 
F=)> Alp; 
i=1 


where p; is the momentum of the ith particle. 
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(a) Calculate the classical partition function Z(N,T) at a temperature T. (You don’t 
have to keep track of numerical constants in the integration.) 

(b) Calculate the pressure and the internal energy of this gas. (Note how the usual 
equipartition theorem is modified for non-quadratic degrees of freedom.) 

(c) Now consider a diatomic gas of N molecules, each with energy 


t 


> 


F; am A (|, 


+ |p 


ex a4 


where the superscripts refer to the two particles in the molecule. (Note that this 
unrealistic potential allows the two atoms to occupy the same point.) Calculate the 
|" 
U 


expectation value (li° -q } at temperature T. 


(d) Calculate the heat capacity ratio y = Cp/Cy, for the above diatomic gas. 


2k OK 2k oko 2k ok 


. Surfactant adsorption: a dilute solution of surfactants can be regarded as an ideal three- 


dimensional gas. As surfactant molecules can reduce their energy by contact with air, a 
fraction of them migrate to the surface where they can be treated as a two-dimensional 
ideal gas. Surfactants are similarly adsorbed by other porous media such as polymers 
and gels with an affinity for them. 


(a) Consider an ideal gas of classical particles of mass m in d dimensions, moving in a 
uniform attractive potential of strength ¢,. By calculating the partition function, or 
otherwise, show that the chemical potential at a temperature T and particle density 


nq is given by 


h 


My = —€g+kpgT ln [nyA(T)*] , Where A(T) = ————. 
/2amkyT 


(b) If a surfactant lowers its energy by €) in moving from the solution to the sur- 
face, calculate the concentration of floating surfactants as a function of the solution 
concentration n (=n), at a temperature T. 

(c) Gels are formed by cross-linking linear polymers. It has been suggested that the 
porous gel should be regarded as fractal, and the surfactants adsorbed on its surface 
treated as a gas in d,-dimensional space, with a non-integer d,. Can this assertion 
be tested by comparing the relative adsorption of surfactants to a gel, and to the 
individual polymers (presumably one-dimensional) before cross-linking, as a function 
of temperature? 


2K 2k oo 2K ok 


« Molecular adsorption: N diatomic molecules are stuck on a metal surface of square 


symmetry. Each molecule can either lie flat on the surface, in which case it must be 
aligned to one of two directions, x and y, or it can stand up along the z direction. There 
is an energy cost of ¢ > 0 associated with a molecule standing up, and zero energy for 
molecules lying flat along x or y directions. 


Problems 


(a) How many microstates have the smallest value of energy? What is the largest 
microstate energy? 

(b) For microcanonical macrostates of energy E, calculate the number of states O(E, N), 
and the entropy S(E, N). 

(c) Calculate the heat capacity C(T) and sketch it. 

(d) What is the probability that a specific molecule is standing up? 

(e) What is the largest possible value of the internal energy at any positive temperature? 


2k ok 2k ok ok 2k ok ok 


. Curie susceptibility: consider N non-interacting quantized spins in a magnetic field 
B= B2, and at a temperature T. The work done by the field is given by BM,, with a 
magnetization M, = 1M, m,. For each spin, m; takes only the 2s+1 values —s, —s+ 
1,---,s—Il,s. 


(a) Calculate the Gibbs partition function 2(T, B). (Note that the ensemble corresponding 
to the macrostate (7, B) includes magnetic work.) 
(b) Calculate the Gibbs free energy G(T, B), and show that for small B, 


Nu*s(s-+1)B? 


B*). 
or 1%) 


G(B)=Gi0)= 


(c) Calculate the zero field susceptibility y = 0M,/0B|,_), and show that it satisfies 


Curie’s law 


X=c/T. 


(d) Show that C, — Cy, = cB?/T?, where C, and Cy are heat capacities at constant B 
and M, respectively. 


AO AO A A OK 
. Langmuir isotherms: an ideal gas of particles is in contact with the surface of a catalyst. 


(a) Show that the chemical potential of the gas particles is related to their temperature 
and pressure via uw = k,T [In (P/T??) + Ao], where Ag is a constant. 

(b) If there are WV distinct adsorption sites on the surface, and each adsorbed particle 
gains an energy € upon adsorption, calculate the grand partition function for the 
two-dimensional gas with a chemical potential ju. 

(c) In equilibrium, the gas and surface particles are at the same temperature and chemical 
potential. Show that the fraction of occupied surface sites is then given by f(T, P) = 
P/(P+P,(T)). Find P,(T). 

(d) In the grand canonical ensemble, the particle number N is a random variable. Cal- 
culate its characteristic function (exp(—ikN)) in terms of Q(B), and hence show 
that 

ang 

Om” | > 


(N™) = (ke) 


> 


where G is the grand potential. 
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10. 


11. 


(e) Using the characteristic function, show that 


(N°) =k p ON) 
c B Om ae 


(f) Show that fluctuations in the number of adsorbed particles satisfy 


(N4), T= 


2k 2k oko 2k ok ok 


Molecular oxygen has a net magnetic spin S of unity, that is, S* is quantized to —1, 0, or 


+1. The Hamiltonian for an ideal gas of N such molecules in a magnetic field B || Z is 


where {p;} are the center of mass momenta of the molecules. The correspond- 
ing coordinates {a} are confined to a volume V. (Ignore all other degrees 
of freedom.) 


(a) Treating {B;, ai} classically, but the spin degrees of freedom as quantized, calculate 
the partition function, Z (T, N, V, B). 

(b) What are the probabilities for S? of a specific molecule to take on values of —1, 0, 
+1 at a temperature T? 

(c) Find the average magnetic dipole moment, (M) /V, where M =  -™, Si. 

(d) Calculate the zero field susceptibility y= 0(M)/0B|,_». 


FR oI 2 2K a ok 


One-dimensional polymer: consider a polymer formed by connecting N disc-shaped 
molecules into a one-dimensional chain. Each molecule can align along either its long 
axis (of length 2a) or short axis (length a). The energy of the monomer aligned along its 
shorter axis is higher by ¢, that is, the total energy is A/ = eU, where U is the number 
of monomers standing up. 


(a) Calculate the partition function, Z(T, N), of the polymer. 

(b) Find the relative probabilities for a monomer to be aligned along its short or long 
axis. 

(c) Calculate the average length, (L(T, N)), of the polymer. 

(d) Obtain the variance, (L(7, N)’) 

(e) What does the central limit theorem say about the probability distribution for the 
length L(T, N)? 


‘ot 


3 oI 2 2K oi KK 
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12. Polar rods: consider rod-shaped molecules with moment of inertia 7, and a dipole 
moment pw. The contribution of the rotational degrees of freedom to the Hamiltonian is 


given by 


I PS 
H,, =— (pt — pEcosé, 
ro 2 (x sin’ i) 


where E is an external electric field. (¢ € [0, 27], 0 € [0, 7] are the azimuthal and polar 
angles, and py, py are their conjugate momenta.) 


(a) Calculate the contribution of the rotational degrees of freedom of each dipole to the 
classical partition function. 

(b) Obtain the mean polarization P = (wcos 6) of each dipole. 

(c) Find the zero-field polarizability 


oP 


XT = aa . 
OE | po 


(d) Calculate the rotational energy per particle (at finite E), and comment on its high- 
and low-temperature limits. 


(e) Sketch the rotational heat capacity per dipole. 


2K OK OK OK OK OK OK OK 
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5 
Interacting particles 


5.1 The cumulant expansion 


The examples studied in the previous chapter involve non-interacting particles. 
It is precisely the lack of interactions that renders these problems exactly 
solvable. Interactions, however, are responsible for the wealth of interesting 
materials and phases observed in nature. We would thus like to understand the 
role of interactions amongst particles, and learn how to treat them in statistical 
mechanics. For a general Hamiltonian, 


Pi > > 
Foy = Se FUG 5 ay) (5.1) 


the partition function can be written as 


33 2 
27.V.N) =, | (“2s pie “H) xp| ay Fe Jos puCG.--- .ay)] 


(5.2) 
= Z,(T, V, N)(exp[—-BU(G.--- 4) ])". 


where Z,(T, V, N) = (v/a3)" /N! is the partition function of the ideal gas 
(Eq. (4.73)), and (Q)° denotes the expectation value of 0 computed with the 
probability distribution of the non-interacting system. In terms of the cumulants 
of the random variable U, Eq. (5.2) can be recast as 


is aT Os (5.3) 


InZ=InZ)+5- 
(=I 


The cumulants are related to the moments by the relations in Section 2.2. Since 
i depends only on {q;}, which are uniformly and independently distributed 
within the box of volume V, the moments are given by 


N 37 
wtf (8) aoe " 


5.1 The cumulant expansion 


Various expectation values can also be calculated perturbatively, from 


N 7 q33 435, >2 
o=s5/TI(* vie i) exo| pr ke |e! BU(G.+*+ + Gv) | xO 
_ (Ocexp[-Bul)" 
(exp[—Bu])° 


The final expectation value generates the joint cumulants of the random vari- 
ables QO and UL, as 


(5.5) 


a : 0 
apt (exp [—ikO — BU]) 


k=0 


In (exp[-ikO — BU)" = > esl a (0% «u')’, (5.6) 
a, #8 ¢ 
in terms of which! 
(0) = ys BY oxu'). (5.7) 


The simplest system for treating interactions is again the dilute gas. As 
discussed in chapter 3, for a weakly interacting gas we can specialize to 
Uq.-- »9v) => VG-— 4). (5.8) 
i<j 
where V(q;—q /;) is a pairwise interaction between particles. The first correction 
in Eq. (5.3) is 
PG 8G; 
mi=D f AAva-a) 
i<j (5.9) 


= NW) [ eava). 


The final result is obtained by performing the integrals over the relative and 
center of mass coordinates of q, and g; separately. (Each of the N(N — 1)/2 
pairs makes an identical contribution.) 
The second-order correction, 
w= XO [(PG-H)VG-W)-(PG-4!VG-H!]. 6.10) 


i<j, k<l 


is the sum of [N(N — 1)/2]? terms that can be grouped as follows: 


(i) There is no contribution from terms in which the four indices {i, j, k, /} are different. This 
is because the different {q,} are independently distributed, and (V(q; — 4;)V (4 — a) 
ey eee 
equals (V(q;—9;)) (V(Gi — %)) - 
(ii) There is one common index between the two pairs, for example, {(i, j), (i, J}. 
By changing coordinates to qj; = q;— 4 and gq, = di — q, it again follows 
that (V\G-4)VG:— 4) equals (V(q;— a;))” (VQqj- a) . The vanishing of these 


' While this compact notation is convenient, it may be confusing. The joint cumulants are 
defined through Eq. (5.6), and for example (1 * 2°). =0 (4 (U‘),.), while (1*U°).=1! 
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terms is a consequence of the translational symmetry of the problem in the absence of 
an external potential. 


(iii) In the remaining M(N — 1)/2 terms the pairs are identical, resulting in 


It 


4 ae 37 2 
(wy) = Mv a tay? (/ <va)) [ (5.11) 


The second term in the above equation is smaller by a factor of d*/V, where d is a 
characteristic range for the potential V. For any reasonable potential that decays with 
distance, this term vanishes in the thermodynamic limit. 


Similar groupings occur for higher-order terms in this cumulant expansion. 
is helpful to visualize the terms in the expansion diagrammatically as follows: 


(a) For a term of order p, draw p pairs of points (representing g; and q;) connected by bonds, 


(b 


(c 


representing the interaction V,;, = V(q; — q;). An overall factor of 1/p! accompanies such 


graphs. At the third order, we have 


1 oa a 
3! » i jj k ol 


i<j, k<l,m<n I J 


Vw 


By multiple selections of the same index i, two or more bonds can be joined together 
forming a diagram of interconnected points. There is a factor S, associated with the 
number of ways of assigning labels 1 through WN to the different points of the graph. 
Ignoring the differences between N, N —1, etc., a diagram with s points makes a 
contribution proportional to N°. There is typically also division by a symmetry factor 
that takes into account the number of equivalent assignments. For example, the diagrams 
involving a pair of points, calculated in Eqs. (5.9) and (5.11), have a symmetry factor of 


1/2. A potential pairing at the third order is 


1 N? ©....0 @....0....0 


3! 2x2 1 2 3 4 5 
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Apart from these numerical prefactors, the contribution of a diagram is an integral over all 
the s coordinates q;, of products of corresponding —BY,,. If the graph has n, disconnected 
clusters, integration over the center of mass coordinates of the clusters gives a factor of 
vy", Thus, the contribution of the above diagram is 

(6) a 
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Fortunately, many cancellations occur in calculating cumulants. In particular: 


When calculating the moment (U?)°, the contribution of a disconnected 
diagram is simply the product of its disjoint clusters. The coordinates of 
these clusters are independent random variables, and make no contribution 
to the joint cumulant (U Py This result also ensures the extensivity of In Z, 
as the surviving connected diagrams give a factor of V from their center 
of mass integration. (Disconnected clusters have more factors of V, and are 
non-extensive.) 


5.1 The cumulant expansion 


© There are also one-particle reducible clusters, which are fully connected, 
yet fall to disjoint fragments if a single coordinate point is removed. By 
measuring all other coordinates relative to this special point, we observe that 
(in a translationally invariant system) the value of such a diagram is the 
product of its disjoint fragments. It can be shown that such diagrams are also 
canceled out in calculating the cumulant. Thus only one-particle irreducible 
clusters survive in this cumulant expansion. A cluster with s sites and p 
bonds makes a contribution of order of V(N/V )*(BYV )? to In Z. These results 
are summarized in the expansion 


InZ=InZ)+V>> 


DS 


CAP OY 5,9 bags 


where D(p, 5s) indicates the sum over the contributions of all one-particle 
irreducible clusters of s sites and p bonds. (The factor of 1/s!, reflecting the 
symmetry of permuting the vertices of clusters, is included for later ease of 
comparison with the cluster expansion.) 


At the second order in (BV ), the perturbative series for the free energy is 
F(T, V,N) =F)(T, V, N+50 >(/ eav@—&— fra Vig) +0(BVv ) 


N3Bev3 
+0 e ) 


(5.13) 


From this expression we can proceed to calculate other modified state functions, 
for example, P = — 0F/0V|,y. Unfortunately, the expansion in powers of BV 
is not particularly useful. The interatomic potential V(r) for most particles has 
an attractive tail due to van der Waals interaction that decays as —1/r® at large 
separations r = |r|. At short distances the overlap of the electron clouds makes 
the potential strongly repulsive. Typically there is a minimum of depth a few 
hundred Kelvin, at a distance of a few angstroms. The infinity in V(7) due to 
the hard core at short distances makes it an unsuitable expansion parameter. 
This problem can be alleviated by a partial resummation of diagrams. For 
example, to get the correction at order of N?/V, we need to sum over all 
two-point clusters, independent of the number of bonds. The resulting sum is 
actually quite trivial, and leads to 


nee +5 CANN) | Siva y+0(*) 


: (5.14) 
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The resummation can be expressed diagrammatically by introducing a new 
bond 
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Fig. 5.1 A typical 
two-body potential V(q) 
(dashed curve), and the 
corresponding resummed 
function f(q) (solid curve). 


Interacting particles 


The quantity f(q) = exp (—BV(q )) — 1 isa much more convenient expansion 
parameter, which goes to —1 at short distances and rapidly vanishes for large 
separations. Clearly, such partial resummations can be performed for bonds 
connecting any pair of vertices, enabling us to remove the summation over p 
in Eq. (5.12), recasting it as a power series in density N/V. The precise form 
of the resulting series is discussed in the next section. 


5.2 The cluster expansion 


For short-range interactions, especially with a hard core, it is much better to 
replace the expansion parameter V(q) by f(q) = exp (—BV(q)) — 1, which is 
obtained by summing over all possible numbers of bonds between two points 
on a cumulant graph. The resulting series is organized in powers of the density 
N/V, and is most suitable for obtaining a virial expansion, which expresses the 
deviations from the ideal gas equation of state in a power series 


= Firman +24 (Z) +} (5.15) 


ky? V 
The temperature-dependent parameters, B,(T), are known as the virial coeffi- 
cients and originate from the interparticle interactions. Our initial goal is to 
compute these coefficients from first principles. 
To illustrate a different method of expansion, we shall perform computations 
in the grand canonical ensemble. With a macrostate M = (T, w, V ), the grand 
partition function is given by 


9(u,T.V) = Ye" Z(N, TV) = : (=) Bi. (5.16) 
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5.2 The cluster expansion 


where 
N 
v= /TleaTla+s,). (5.17) 
i=l i<j 


and fij = f(q- qj). 
The 2M~)/? terms in 8y can now be ordered in powers of f;,; as 


N 

sy= [Tea (14D s+ 2 futu). (5.18) 
i=l i<j i<j,k<l 

An efficient method for organizing the perturbation series is to represent the 

various contributions diagrammatically. In particular, we shall apply the fol- 

lowing conventions: 


(a) Draw N dots labeled by i= 1,--- , N to represent the coordinates g, through qy, 
e ° ° 
; : ei si 
(b) Each term in Eq. (5.18) corresponds to a product of f;;, represented by drawing lines 
connecting i and j for each f;;. For example, the graph 
° e-e o—e-e e 
i 22 44 @ °° # 


represents the integral 


([ Pa) ([ ParPasfrs) ([ BaP as acfassss) <([ Pay) - 


As the above example indicates, the value of each graph is the product 
of the contributions from its linked clusters. Since these clusters are more 
fundamental, we reformulate the sum in terms of them by defining a quantity 
b,, equal to the sum over all £-particle linked clusters (one-particle irreducible 
or not). For example, 


p= =[@4= V, (5.19) 
and 
b= 0-0 = [ PAP HSM -%)- (5.20) 


There are four diagrams contributing to b,, leading to 


b;=e—e + e-e + ee + e-e@ 
= / PIP Hd G3[MG — Mh — 3) +b - BMG —-H) + NG — WMG -— &) 


+ fa - DD) - BSG a) ]- (5.21) 


A given N-particle graph can be decomposed into n, 1-clusters, n, 2-clusters, 
--+, n, €-clusters, etc. Hence, 


Sy = Do [Loi Wn}, (5.22) 
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where the restricted sum is over all distinct divisions of N points into a set of 
clusters {n,}, such that }°, €n, = N. The coefficients W({n,}) are the number 
of ways of assigning N particle labels to groups of n, ¢-clusters. For example, 
the divisions of three particles into a 1-cluster and a 2-cluster are 


e e-—e e e-—e e e-@e 
F , and 
1 2 3 2 1 3 3 2 1 


All the above graphs have n, = | and n, = 1, and contribute a factor of b,b, 
to $3; thus, W(1, 1) = 3. Other possible divisions of a three-particle system are 
to three 1-point clusters, or one 3-point cluster, leading to 


ar 
S;=e oe e+\e-e e-e © e e-e 
= b} +3b,b, +d. 


In general, W({n,}) is the number of distinct ways of grouping the labels 
1,---, N into bins of n, €-clusters. It can be obtained from the total number 
of permutations, N!, after dividing by the number of equivalent assignments. 
Within each bin of én, particles, equivalent assignments are obtained by: 
(i) permuting the £ labels in each subgroup in ¢! ways, for a total of (£!)” 
permutations; and (ii) the n,! rearrangements of the n, subgroups. Hence, 

N! 
W({n-}) = Te ny! (£!)re . 
(We can indeed check that W(1, 1) = 3!/(1!)(2!) =3 as obtained above.) 

Using the above value of W, the expression for Sy in Eq. (5.22) can be 
evaluated. However, the restriction of the sum to configurations such that 
>=, £n, = N complicates the calculation. Fortunately, this restriction disappears 
in the expression for the grand partition function in Eq. (5.17), 

ef i N! my 
Q= by‘. 5.24 
x N! ( 2 Te me! (1) *y : oe 
The restriction in the second sum is now removed by noting that 
Vev=0 Lm} OF, ey, = L{n,}- Therefore, 


(5.23) 
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The above result has the simple geometrical interpretation that the sum over 
all graphs, connected or not, equals the exponential of the sum over connected 


5.2 The cluster expansion 


clusters. This is a quite general result that is also related to the graphical 
connection between moments and cumulants discussed in Section 2.1. 
The grand potential is now obtained from 


PV & (ebH\* b, 
no——p3s — = 5.26 
" eae > (5) i! Cay) 


In Eq. (5.26), the extensivity condition is used to get G = E—TS—pwN =—PV. 
Thus, the terms on the right-hand side of the above equation must also be 
proportional to the volume V. This can be explicitly verified by noting that 
in evaluating each b, there is an integral over the center of mass coordinate 
that explores the whole volume. For example, b, = f d°¢,d°q.f(q) — @) = 
V f Pay f (412). Quite generally, we can set 


lim by = Vby, (5.27) 
and the pressure is now obtained from 


P&H) 5, 
a->(S) ae (5.28) 


l=1 


The linked cluster theorem ensures G « V, since if any non-linked cluster had 
appeared in In Q, it would have contributed a higher power of V. 

Although an expansion for the gas pressure, Eq. (5.28) is quite different from 
Eq. (5.15) in that it involves powers of e% rather than the density n = N/V. 
This difference can be removed by solving for the density in terms of the 
chemical potential, using 


(5.29) 


_ ain =r¢(@) Vy 
abe) oe) a 


The equation of state can be obtained by eliminating the fugacity x = e®*/A°, 
between the equations 


a os P 9: ah 
n=) ——D,, and —=) —}b,, (5.30) 
= (e-1! ¢ kT d i 
using the following steps: 
(a) Solve for x(n) from (6, = f d°g/V = 1) 
b 
x=n—Bx* ml tee (5.31) 


The perturbative solution at each order is obtained by substituting the solution at the 


previous order in Eq. (5.31), 
x, =n+O(n’), 
xX, =n—b,n*?+ O(n’), (5.32) 


b b 
x3 =n—b,(n—B,n)* aa +0(n*) =n—5,n? 4+ (20. 2 2) m+O(n4). 
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(b) Substitute the perturbative result for x(n) into Eq. (5.30), yielding 


b. Bb 
PP=xt7x tert 
b b b 
=n— bys (20, a) + ud By + le (5.33) 


b. 5 
=n— 3” + (02 - >) w+Q(n'). 
The final result is in the form of the virial expansion of Eq. (5.15), 
BP =n+)>°B,(T)n‘. 
é=2 


The first term in the series reproduces the ideal gas result. The next two 
corrections are 


By=—a=—5 [by (PMO 1) (5.34) 


and 
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= 5 | PG MG) Mh) fir — da). (5.35) 


The above example demonstrates the cancellation of the one-particle reducible 
clusters that appear in b,. While all clusters (reducible or not) appear in the 
sum for b,, as demonstrated in the previous section, only the one-particle 
irreducible ones can appear in an expansion in powers of density. The final 
expression for the ¢th virial coefficient is thus 
(¢—1) 

fe 
where d, is defined as the sum over all one-particle irreducible clusters of 
points. 

This result can also be obtained from the expansion of the partition function 
in Eq. (5.12). The key observation is that the summation over all powers of 
BV (leading to multiple connections between pairs of sites) in the diagrams 
considered in the previous section, results in precisely the clusters introduced in 
this section (with pairs of sites connected by f). Thus, >°,,(—B)’/(p!)D(p, £) = 
d,, and 


BT) = 


(5.36) 
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reproducing the above virial expansion from BP = d1InZ/OoV. 


5.3 The second virial coefficient and van der Waals equation 


5.3 The second virial coefficient and van der Waals 
equation 


Let us study the second virial coefficient B, for a typical gas using Eq. (5.34). 
As discussed before, the two-body potential is characterized by a hard core 
repulsion at short distances and a van der Waals attraction at large distances. 
To make the computations easier, we shall use the following approximation 
for the potential: 


+00 for r< 1% 


V(r) = (5.38) 


=U (ro/r)° for r> ro ; 


which combines both features. The contributions of the two portions can then 
be calculated separately, as 


b= fp &r(e #1) 
0 


. (5.39) 
=| 4nrar(-1) +f 4mrar [renner = 1]. 
0 ro 


V(r) 


—Ug (ro/r)® 


The second integrand can be approximated by Bu)(r/r)° in the high- 
temperature limit, Bu, > 1, and leads to 


1] 4a P\lP | _ 2a 
n.=-3|- To 4 AmBuyrs (-) |- 7") (1 — Bug). (5.40) 
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3 


We can define an excluded volume of O. = 47rj/3, which is 8 times the atomic 
volume (since the distance of minimum approach rp is twice an atomic radius), 
to get 


B,(T) = . (1- 7) (5.41) 
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Fig. 5.2 The continuous 
two-body potential (solid 
curve) is replaced by a 
hard core and an 
attractive tail (dashed 
curve). 
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Remarks and observations: 


(1) The tail of the attractive van der Waals interaction (« r~°) extends to very long separa- 


tions. Yet, its integral in Eq. (5.40) is dominated by contributions from the short scales 
Yo. In this limited context, the van der Waals potential is short-ranged, and results in 
corrections to the ideal gas behavior that are analytical in density n, leading to the virial 


series. 


(2) By contrast, potentials that fall off with separation as 1/r* or slower are long-ranged. 


The integral appearing in calculation of the second virial coefficient is then dominated by 
long distances, and is divergent. As a result, corrections to the ideal gas behavior cannot 
be written in the form of a virial series, and are in fact non-analytic. A good example 
is provided by the Coulomb plasma discussed in the problem section. The non-analytic 
corrections can be obtained by summing all the ring diagrams in the cumulant (or cluster) 
expansions.” 


(3) The second virial coefficient has dimensions of volume and (for short-range potentials) 


is proportional to the atomic volume ©. In the high-temperature limit, the importance of 
corrections to ideal gas behavior can be estimated by comparing the first two terms of 
Eq. (5.15), 

Bn? B, atomic volume gas density 


yr Saag ae —% (5.42) 
n n-! volume per particle in gas _ liquid density 


This ratio is roughly 10~* for air at room temperature and pressure. The corrections to 
ideal gas behavior are thus small at low densities. On dimensional grounds, a similar ratio 
is expected for the higher-order terms, B,n‘/B,_,n‘', in the virial series. We should thus 


be wary of the convergence of the series at high densities (when the gas may liquify). 


(4) The virial expansion breaks down not only at high densities, but also at low temperatures. 


This is suggested by the divergences in Eqs. (5.41) and (5.39) as T — 0, and reflects the 
fact that in the presence of attractive interactions the particles can lower their energy at 
low temperatures by condensing into a liquid state. 


(5) The truncated virial expansion, 


P Q 
= (1 7 aaa (5.43) 
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? Consider a potential with typical strength u, and range A. Each bond in the cumulant 


expansion contributes a factor of BV, while each node contributes N f d°q/V. Dimensional 
arguments then suggest that a diagram with b bonds and s nodes is proportional to 
(Bu)’(NA3/V)’. At a given order in Bu, the factor of nA? thus discriminates between weakly 
and strongly interacting systems. For nA? < 1 (dilute gas, or short-range interactions) the 
diagrams with the fewest nodes should be included. For nA? >> 1 (dense gas, or long-range 
interactions) the ring diagrams, which have the most nodes, dominate. 


5.3 The second virial coefficient and van der Waals equation 


This is precisely in the form of the van der Waals equation 


2 
E we (7) ly *| = NkT, (5.45) 


and we can identify the van der Waals parameters, a = uj Q./2 and b= Q,/2. 


Physical interpretation of the van der Waals equation: historically, van der 
Waals suggested Eq. (5.45) on the basis of experimental results for the equation 
of state of various gases, toward the end of the nineteenth century. At that 
time the microscopic interactions between gas particles were not known, and 
van der Waals postulated the necessity of an attractive interaction between gas 
atoms based on the observed decreases in pressure. It was only later on that 
such interactions were observed directly, and then attributed to the induced 
dipole-dipole forces by London. The physical justification of the correction 
terms is as follows. 

(a) There is a correction to the gas volume V due to the exclusions. At first 
sight, it may appear surprising that the excluded volume b in Eq. (5.45) is one 
half of the volume that is excluded around each particle. This is because this 
factor measures a joint excluded volume involving all particles in phase space. 
In fact, the contribution of coordinates to the partition function of the hard-core 
gas can be estimated at low densities, from 


Tg, 1 
Sy= et = vv Q)(V—20)---(V—(N —1)Q) 
1 noa,\* 
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The above result is obtained by adding particles one at a time, and noting that 
the available volume for the (m+ 1)th particle is (V—mQ,). At low densities, 
the overall effect is a reduction of the volume available to each particle by 
approximately 0,/2. Of course, the above result is only approximate since the 
effects of excluded volume involving more than two particles are not correctly 
taken into account. The relatively simple form of Eq. (5.46) is only exact for 
spatial dimensions d = 1, and at infinity. As proved in the problems, the exact 
excluded volume at d = | is in fact 0. 

(b) The decrease in P, due to attractive interactions, is somewhat harder to 
quantify. In Section 3.6, the gas pressure was related to the impacts of particles 
on a wall via 


P= (nv,)Qmv,)| = nmvy, (5.47) 


where the first term is the number of collisions per unit time and area, while 
the second is the momentum imparted by each particle. For the ideal gas, the 
usual equation of state is recovered by noting that the average kinetic energy is 
mv? / 2=k,T/2. Attractive interactions lead to a reduction in pressure given by 


6P =6n (mv?) 468 (mi?) (5.48) 
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While the pressure of a gas is a bulk equilibrium property, in Eq. (5.48) 
it is related to behavior of the particles close to a surface. The following 
interpretations of the result depend on distinct assumptions about the relaxation 
of particles at the surface. 

In a canonical ensemble, the gas density is reduced at the walls. This 
is because the particles in the middle of the box experience an attractive 
potential U from all sides, while at the edge only an attractive energy of 
U/2 is available from half of the space. The resulting change in density is 
approximately 


dn © n(e PY? —e PY) & BnU/2. (5.49) 
Integrating the interaction of one particle in the bulk with the rest gives 
U= / FV ny (Fn = —nQuy. (5.50) 


The change in density thus gives the pressure correction of 6P = —n?Quy/2 
calculated in Eq. (5.45). There is no correction to the kinetic energy of the 
particles impinging on the wall, since in the canonical formulation the probabil- 
ities for momentum and location of the particles are independent variables. The 
probability distribution for momentum is uniform in space, giving the average 
kinetic energy of k,7/2 for each direction of motion. 

The range of decreased density close to the wall in the above description may 
be quite small; of the order of the range of the interaction between particles. 
If this length is smaller than the mean free path between collisions, we may 
well question the assumption that the surface particles can be described by an 
equilibrium ensemble. An alternative explanation can then be formulated in 
which particles close to the surface simply follow deterministic Hamiltonian 
equations in an effective potential, without undergoing any collisions. In this 
formulation, the impinging particles lose kinetic energy in approaching the 
wall, since they have to climb out of the potential well set up by the attractions 
of the bulk particles. The reduction in kinetic energy is given by 


2 
mv, 


2 


1 5 1 
| PTV in (n= — gn Qug. (5.51) 


The reduced velocities lead to an increase in the surface density in this case, 
as the slower particles spend a longer time 7 in the vicinity of the wall! The 
relative change in density is given by 

én OT dv, 1 dvr 


RS, = in = —in/2. (5.52) 


The increase in density is precisely the opposite of the result of Eq. (5.49) 
in the equilibrium formulation. However, with the decrease in kinetic energy 
calculated in Eq. (5.51), it again leads to the correct reduction in pressure. 


5.4 Breakdown of the van der Waals equation 


5.4 Breakdown of the van der Waals equation 


As discussed in Section 1.9, mechanical stability of a gas requires the positivity 
of the isothermal compressibility, k; = —V~! V/0P|,. This condition can be 
obtained by examining density fluctuations in a grand canonical ensemble. The 
probability of finding N particles in a volume V is given by 
eF4NZ(T, N,V) 

a an, 

Since for a gas InQ = —BG = PV/k,T, the mean and variance of N simplify 
to 


P(N, V) = (5.53) 
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Dividing the two equations, and using the chain rule, results in 
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Net _ ks =i (5.55) 
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The positivity of x; is thus tied to that of the variance of N. A stable value 
of N corresponds to a maximum of the probability p(N, V ), that is, a positive 
compressibility. A negative x; actually corresponds to a minimum in p(N, V ), 
implying that the system is least likely to be found at such densities. Fluctuations 
in density will then occur spontaneously and change the density to a stable 
value. 

Any approximate equation of state, such as the van der Waals equation, must 
at least satisfy the stability requirements. However, the van der Waals isotherms 
contain a portion with — dP/dV|, <0, for temperatures less than a critical 
value T.. The negative compressibility implies an instability toward forming 
domains of lower and higher density, that is, phase separation. The attractive 
interactions in real gases do indeed result in a liquid—gas phase separation at 
low temperatures. The isotherms then include a flat portion, dP/dV|, = 0, at 
the coexistence of the two phases. Can the (unstable) van der Waals isotherms 
be used to construct the phase diagram of a real gas? 

One way of doing so is by the following Maxwell construction: the variations 
of the chemical potential w(T, P) along an isotherm are obtained by integrating 
Eq. (5.54), as 


-_— (5.56) 


eae = er ae P,)+ fap 

N Pa 
Since the van der Waals isotherms for T < T, are non-monotonic, there is a 
range of pressures that correspond to three different values, {u,,}, of the chem- 
ical potential. The possibility of several values of wz at a given temperature and 
pressure indicates phase coexistence. In equilibrium, the number of particles in 
each phase N, adjusts so as to minimize the Gibbs free energy G= >, My Ny. 
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Fig. 5.3 lsotherms of the 
van der Waals equation 
have an unphysical 
portion at low 
temperature. By contrast, 
a real gas (inset) has a 
coexistence region 
(indicated in gray) with 
flat isotherms. 


Fig. 5.4 Using the 
Maxwell equal-area 
construction, the 
unstable portion of the 
isotherm from C to D is 
replaced with the 
“tie-line” BE. The 
regions BCO and EDO 
have equal area. The 
isothermal portions BC 
and DE are metastable. 
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Clearly, the phase with lowest mw, will acquire all the particles. A phase transi- 
tion occurs when two branches of allowed chemical potentials intersect. From 
Eq. (5.56), the critical pressure P. for this intersection is obtained from the 
condition 


f ” aP'V(T, P’) =0. (5.57) 
A geometrical interpretation of the above result is that P. corresponds to a 
pressure that encloses equal areas of the non-monotonic isotherm on each 
side. The Maxwell construction approach to phase separation is somewhat 
unsatisfactory, as it relies on integrating a clearly unphysical portion of the van 
der Waals isotherm. A better approach that makes the approximations involved 
more apparent is presented in the next section. 
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5.5 Mean-field theory of condensation 


5.5 Mean-field theory of condensation 


In principle, all properties of the interacting system, including phase separa- 
tion, are contained within the thermodynamic potentials that can be obtained 
by evaluating Z(T,N) or Q(T, w). Phase transitions, however, are charac- 
terized by discontinuities in various state functions and must correspond to 
the appearance of singularities in the partition functions. At first glance, it is 
somewhat surprising that any singular behavior should emerge from computing 
such well-behaved integrals (for short-ranged interactions) as 
N 3S 43 N 2 
z(r.n,v)= f Tied bd oo Dae pEra.-a) (5.58) 
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Instead of evaluating the integrals perturbatively, we shall now set up a reason- 
able approximation scheme. The contributions of the hard core and attractive 
portions of the potential are again treated separately, and the partition function 
approximated by 


Z(T,N,V)® — _ V(V—Q)---(V—(N—1)Q) exp(—BU). (5.59) 
! 


Excluded volume effects 
Here U represents an average attraction energy, obtained by assuming a uniform 
density n= N/V, as 
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(5.60) 
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The key approximation is replacing the variable local density n(7) with the 
uniform density n. The parameter u describes the net effect of the attractive 
interactions. Substituting into Eq. (5.59) leads to the following approximation 
for the partition function: 


Z(T,N,V)& 


Ney exp | : (5.61) 


N!ABN 2V 
From the resulting free energy, 


N2 
F = —kgT InZ = —NkgT In(V — NO/2) + NkgT In(N/e) + 3NkgT Ind — _ 


(5.62) 


we obtain the expression for the pressure in the canonical ensemble as 


OF Nk,T N? 
an = =. (5.63) 
Viry V—-NQ/2  2V? 


Remarkably, the uniform density approximation reproduces the van der 
Waals equation of state. However, the self-consistency of this approximation 
can now be checked. As long as Ky is positive, Eq. (5.55) implies that the 
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variance of density vanishes for large volumes as (n’). =k,Tn’k,/V. But ky 
diverges at T., and at lower temperatures its negativity implies an instability 
toward density fluctuations as discussed in the previous section. When conden- 
sation occurs, there is phase separation into high (liquid) and low (gas) density 
states, and the uniform density assumption becomes manifestly incorrect. This 
difficulty is circumvented in the grand canonical ensemble. Once the chemical 
potential is fixed, the number of particles (and hence density) in this ensemble 
is automatically adjusted to that of the appropriate phase. 

As the assumption of a uniform density is correct for both the liquid and gas 
phases, we can use the approximations of Eqs. (5.60) and (5.61) to estimate 
the grand partition function 


= = va N? 
Q(T, w, V) = Yo eP#NZ(T, N,V) © Yo exp [vin (5 = =) pee +AN] . 
N=0 N=0 N 2, 2V 


(5.64) 


where A = 1+ 6 —In(A). As in any sum over exponentials in N, the above 
expression is dominated by a particular value of particle number (hence den- 
sity), and given by 


Q(T, w, V) © exp {ax [sa+vin (5 — =) + | ‘ (5.65) 
Hence, the grand canonical expression for the gas pressure is obtained from 
BPac. = “* = max[V(n)],,, (5.66) 
where 
W(n) = nA+nin (wr = >) + Pe, (5.67) 


The possible values of density are obtained from dW/dn|,, =0, and satisfy 


0, 1 
A=-!1 a : 5.68 
a(n! -5)+ qa Pe (5.68) 


The above equation in fact admits multiple solutions n, for the density. Sub- 
stituting the resulting A into Eq. (5.66) leads after some manipulation to 


NgkpT u 


5 7 la | = max([P,, 
1-2, Q./2 sn] max[Poan (a) Ja, (5.69) 


that is, the grand canonical and canonical values of pressure are identical at a 
particular density. However, if Eq. (5.68) admits multiple solutions for the den- 
sity at a particular chemical potential, the correct density is uniquely determined 
as the one that maximizes the canonical expression for pressure (or for y(7)). 

The mechanism for the liquid—gas phase transition is therefore the following. 
The sum in Eq. (5.64) is dominated by two large terms at the liquid and gas 
densities. At a particular chemical potential, the stable phase is determined by 


5.6 Variational methods 


4 wo) 


Niiquid 


the larger of the two terms. The phase transition occurs when the dominant 
term changes upon varying the temperature. In mathematical form, 


VP.., for T>T* 
InQ= lim In [eFVPiiauia + eBVPras ] = BVP a 


. (5.70) 
V-r00 BVPiiquia for T < T* 


The origin of the singularity in density can thus be traced to the thermodynamic 
limit of V — oo. There are no phase transitions in finite systems! 


5.6 Variational methods 


Perturbative methods provide a systematic way of incorporating the effect of 
interactions but are impractical for the study of strongly interacting systems. 
While the first few terms in the virial series slightly modify the behavior of the 
gas, an infinite number of terms have to be summed to obtain the condensation 
transition. An alternative, but approximate, method for dealing with strongly 
interacting systems is the use of variational methods. 

Suppose that in an appropriate ensemble we need to calculate Z = 
tr (eave . In the canonical formulation, Z is the partition function corre- 
sponding to the Hamiltonian H at temperature kzT = 1/8, and for a classical 
system “tr” refers to the integral over the phase space of N particles. However, 
the method is more general and can be applied to Gibbs or grand partition 
functions with the appropriate modification of the exponential factor; also in 
the context of quantum systems where “‘tr” is a sum over all allowed quantum 
microstates. Let us assume that calculating Z is very difficult for the (inter- 
acting) Hamiltonian 4, but that there is another Hamiltonian F(o, acting on 
the same set of degrees of freedom, for which the calculations are easier. We 
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Fig. 5.5 The appropriate 
uniform density is 
obtained from the 
maximum of i(n). 
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Fig. 5.6 A convex curve is 
always above a tangent 
line to the curve at any 
point. 
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then introduce a Hamiltonian H(A) = Hy)+A(H — A), and a corresponding 
partition function 


Z(A) = tr{exp[—BHo — AB(H — Hy)]}, (5.71) 


which interpolates between the two as A changes from zero to one. It is then 
easy to prove the convexity condition 
d?InZ(A 
one) =p ((x- H,)’) = 0, (5.72) 


where () is an expectation value with the appropriately normalized probability. 


dln Z 


In Z(0)+A 
dA |,=0 


From the convexity of the function, it immediately follows that 


diInZ 


InZ(A) > InZ r 
nZ(A) > InZ(0)+ A 


(5.73) 
A=0 
But it is easy to see that dln Z/dA|,_) =B(H,)-H yo where the superscript 
indicates expectation values with respect to Fy). Setting A = 1, we obtain 


InZ > InZ(0)+B (Hy) —B(H)°. (5.74) 


Equation (5.74), known as the Gibbs inequality, is the basis for most vari- 
ational estimates. Typically, the “simpler” Hamiltonian H, (and hence the 
right-hand side of Eq. (5.74)) includes several parameters {n,}. The best esti- 
mate for In Z is obtained by finding the maximum of the right-hand side with 
respect to these parameters. It can now be checked that the approximate evalu- 
ation of the grand partition function Q in the preceding section is equivalent to 
a variational treatment with A) corresponding to a gas of hard-core particles 
of density n, for which (after replacing the sum by its dominant term) 


InQ) = BuN+InZ=V E (1 + Bu —In(d’)) +nIn (m = >)| : (5.75) 


5.7 Corresponding states 


The difference F( — FH, contains the attractive portion of the two-body interac- 
tions. In the regions of phase space not excluded by the hard-core interactions, 
the gas in Af, is described by a uniform density n. Hence, 


B(Hy-H) = pv eu, (5.76) 


and 


BP= as > E (1+ Bu—In(a’))+nIn (w" - >) + Bun’ (5.77) 


which is the same as Eq. (5.67). The density n is now a parameter on the right- 
hand side of Eq. (5.77). Obtaining the best variational estimate by maximizing 
with respect to n is then equivalent to Eq. (5.66). 


5.7 Corresponding states 


We now have a good perturbative understanding of the behavior of a 
dilute interacting gas at high temperatures. At lower temperatures, attractive 
interactions lead to condensation into the liquid state. The qualitative behavior 
of the phase diagram is the same for most simple gases. There is a line of 
transitions in the coordinates (P, T ) (corresponding to the coexistence of liquid 
and gas in the (V, 7) plane) that terminates at a so-called critical point. It is 
thus possible to transform a liquid to a gas without encountering any singular- 
ities. Since the ideal gas law is universal, that is, independent of material, we 
may hope that there is also a generalized universal equation of state (presum- 
ably more complicated) that describes interacting gases, including liquid/gas 
condensation phenomena. This hope motivated the search for a law of corre- 
sponding states, obtained by appropriate rescalings of state functions. The most 
natural choice of scales for pressure, volume, and temperature are those of the 
critical point, (P., V,., T.). 

The van der Waals equation is an example of a generalized equation of 
state. Its critical point is found by setting dP/dV|, and #P/AV? |, to zero. 
The former is the limit of the flat coexistence portion of liquid/gas isotherms; 
the latter follows from the stability requirement x; > 0 (see the discussion 
in Section 1.9). The coordinates of the critical point are thus obtained from 
solving the following coupled equations: 


Pe 


v-b wv 
| aP k,T 2a 
dv - (v—b) - v ae (5.78) 
| ap _ 2kyT _ 6a _y 
[ wv}, (v—-b3s vt” 
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where v = V/N is the volume per particle. The solution to these equations is 


[ 2=s5 
© 97b? 
v,.=3b (5.79) 
| 8a 
k,T, = — 
(°3"° 97b 


Naturally, the critical point depends on the microscopic Hamiltonian (e.g., 
on the two-body interaction) via the parameters a and b. However, we can 
scale out such dependencies by measuring P, T, and v in units of P., T., and 
v,. Setting P, = P/P., v, = v/v,, and T, = T/T, a reduced version of the van 
der Waals equation is obtained as 


8 = «6T. 3 
Pe aa (5.80) 
3v,-1/3 w 


r 


We have thus constructed a universal (material-independent) equation of state. 
Since the original van der Waals equation depends only on two parameters, 
Eqs. (5.79) predict a universal dimensionless ratio, 


Pove = = 0.375. (5.81) 
kgf, 8 
Experimentally, this ratio is found to be in the range of 0.28 to 0.33. The 
van der Waals equation is thus not a good candidate for the putative universal 
equation of state. 

We can attempt to construct a generalized equation empirically by using 
three independent critical coordinates, and finding P, = p,(v,,T,) from the 
collapse of experimental data. Such an approach has some limited success in 
describing similar gases, for example, the sequence of noble gases Ne, Xe, Kr, 
etc. However, different types of gases (e.g., diatomic, ionic, etc.) show rather 
different behaviors. This is not particularly surprising given the differences in 
the underlying Hamiltonians. We know rigorously from the virial expansion 
that perturbative treatment of the interacting gas does depend on the details of 
the microscopic potential. Thus the hope of finding a universal equation of state 
for all liquids and gases has no theoretical or experimental justification; each 
case has to be studied separately starting from its microscopic Hamiltonian. 
It is thus quite surprising that the collapse of experimental data does in fact 
work very well in the vicinity of the critical point, as described in the next 
section. 


5.8 Critical point behavior 


To account for the universal behavior of gases close to their critical point, let 
us examine the isotherms in the vicinity of (P., v,, T..). For T > T,, a Taylor 
expansion of P(T, v) in the vicinity of v,, for any T, gives 


5.8 Critical point behavior 


1 &P| 
2 av? |, 


1 a P| 
6 dv} | 


P(T,») = PCT) + | waa) + (vu)? + 


(vv Pe 
le T 


(5.82) 


Since 0P/dv|, and 0? P/ dv", are both zero at T., the expansion of the deriva- 
tives around the critical point gives 


P(T, v.) = P,+a(T-T.)+O[(T-T)], 


oP 
a =-a(T-T,)+O[(T-T,)’], 
dv Ty, 
“P 5 (5.83) 
—_ = d(T —-T. T-—T) 
aa |, =O TItO[T-T'], 
oP 
<~|  =-c+0[(T-7,)], 
au3 Te.V¢ 


where a, b, and c are material-dependent constants. The stability condition, 
d5Pév < 0, requires a > 0 (for T> T.) and c > 0 (for T = T,.), but provides 
no information on the sign of b. If an analytical expansion is possible, the 
isotherms of any gas in the vicinity of its critical point must have the general 
form, 


PUD, v) = P+. a(T-T,)—a(P = T)(v=v.) + 7(T—T)(0=v,)? = E0= w+ 
(5.84) 


Note that the third and fifth terms are of comparable magnitude for (T — T.) ~ 
(v—v,)*. The fourth (and higher-order) terms can then be neglected when this 


condition is satisfied. 
The analytic expansion of Eq. (5.84) results in the following predictions for 
behavior close to the critical point: 


(a) The gas compressibility diverges on approaching the critical point from the high- 


temperature side, along the critical isochore (v = v.), as 


1 ap" 1 
lim k(T,v,) = = ‘ (5.85) 
Tote v, Ov|,  v,a(T—T,) 


(b) The critical isotherm (T = T.) behaves as 
c 
P=P,—<(v—v,)) + (5.86) 


(c) Equation (5.84) is manifestly inapplicable to T < T.. However, we can try to extract 
information for the low-temperature side by applying the Maxwell construction to the 
unstable isotherms (see the problem section). Actually, dimensional considerations are 
sufficient to show that on approaching T. from the low-temperature side, the specific 


volumes of the coexisting liquid and gas phases approach each other as 


lim (gas a Viiquia) x (T, a ie (5.87) 
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The liquid—gas transition for T < T, is accompanied by a discontinuity in 
density, and the release of latent heat L. This kind of transition is usually 
referred to as first order or discontinuous. The difference between the two 
phases disappears as the sequence of first-order transitions terminates at the 
critical point. The singular behavior at this point is attributed to a second-order 
or continuous transition. Equation (5.84) follows from no more than the con- 
straints of mechanical stability, and the assumption of analytical isotherms. 
Although there are some unknown coefficients, Eqs. (5.86)—(5.87) predict uni- 
versal forms for the singularities close to the critical point and can be compared 
to experimental data. The experimental results do indeed confirm the general 
expectations of singular behavior, and there is universality in the results for 
different gases that can be summarized as: 


(a) The compressibility diverges on approaching the critical point as 


lim, K(T,v,) «(T-—T.)’, with y~ 1.3. (5.88) 


TT? 


(b) The critical isotherm behaves as 
(P—P.)x(v—v,)*, with 65.0. (5.89) 
(c) The difference between liquid and gas densities vanishes close to the critical point as 
a 
ae (Priguia is Peas) x an ged _ Viiguia) x (T, = T) > with p & 0.3. (5.90) 


These results clearly indicate that the assumption of analyticity of the 
isotherms, leading to Eq. (5.84), is not correct. The exponents 6, y, and B 
appearing in Eqs. (5.89)-(5.90) are known as critical exponents. Understanding 
the origin, universality, and numerical values of these exponents is a fascinating 
subject covered by the modern theory of critical phenomena, which is explored 
in a companion volume. 


Problems for chapter 5 


1. Debye-Hiickel theory and ring diagrams: the virial expansion gives the gas pressure 
as an analytic expansion in the density n = N/V. Long-range interactions can result 
in non-analytic corrections to the ideal gas equation of state. A classic example is the 
Coulomb interaction in plasmas, whose treatment by Debye—Hiickel theory is equivalent 
to summing all the ring diagrams in a cumulant expansion. 

For simplicity consider a gas of N electrons moving in a uniform background of positive 
charge density Ne/V to ensure overall charge neutrality. The Coulomb interaction takes 
the form 


2 


a) . : r 
Ug => V(4;-4;)> with V(q)= ama ° 


Iq| 
i<j 


The constant c results from the background and ensures that the first-order correction 
vanishes, that is, f d°qV(q) =0. 


Problems 


(a) Show that the Fourier transform of V(q) takes the form 


? (6) [ele for @ 40 
@)= : 
(9° for @=0 


(b) In the cumulant expansion for (ut). we shall retain only the diagrams forming a 


ring, which are proportional to 


Oo Oe os peat ss re 2 se fe 
Ry =f at V(Gi — @)V (G2 — 43) ++ Ve - H1)- 
V V 
Use properties of Fourier transforms to show that 
1 Co ~ 
RS. | Soa 
=gal oa 


c) Show that the number of ring graphs generated in (2 : is 
(c) g graphs g ole 


N! £—1)! £—1)! 
oe (=! =D, 
(N— 2)! 2 2 


(d) Show that the contribution of the ring diagrams can be summed as 


In Zyings = In Zy + yD 
(=2 


i roe ie Ey. ; ink 
In n > 
9" 250 (203 w w? 


where k = ,/ Be?N/V is the inverse Debye screening length. 
(Hint. Use In(1+x) = — 7, (—x)‘/2.) 


(e) The integral in the previous part can be simplified by changing variables to x = k/a, 


and performing integration by parts. Show that the final result is 


InZ 


rings 


InZ pei : 
=In K. 
o" 12a 


(f) Calculate the correction to pressure from the above ring diagrams. 

(g) We can introduce an effective potential V(q—q’) between two particles by integrat- 
ing over the coordinates of all the other particles. This is equivalent to an expectation 
value that can be calculated perturbatively in a cumulant expansion. If we include 


only the loopless diagrams (the analog of the rings) between the particles, we have 


ag BG 7 oa Sa ee 
as 7 VG U)V(G —h)-* 


VQe-q'). 


WG-4) =VG-4') + (BN)! [ 
é=1 


Show that this sum leads to the screened Coulomb interaction V(q) = 
e* exp(—K|q|)/(471q|). 


2k ok ook aK RK 
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2. Virial coefficients: consider a gas of particles in d-dimensional space interacting through 


a pairwise central potential, V(r), where 


{ +00 for 0 <r<a, 
Viry=4-e fora<r<b, 


0 for b<r<o. 


(a) Calculate the second virial coefficient B,(T), and comment on its high- and low- 
temperature behaviors. 


(b) Calculate the first correction to isothermal compressibility 


(c) In the high-temperature limit, reorganize the equation of state into the van der Waals 
form, and identify the van der Waals parameters. 
(d) For b =a (a hard sphere), and d = 1, calculate the third virial coefficient B;(T7). 


2K ok ok ok kK 


. Dieterici’s equation: a gas obeys Dieterici’s equation of state: 


a 
P(v—b) =k,T exp aa aes 
B 


where v= V/N. 


(a) Find the ratio Pu/k,T at the critical point. 
(b) Calculate the isothermal compressibility «, for v= v, as a function of T — T,. 
(c) On the critical isotherm expand the pressure to the lowest non-zero order in (v—v,). 


2K 2k ok ok kK 


. Two-dimensional Coulomb gas: consider a classical mixture of N positive and N negative 


charged particles in a two-dimensional box of area A = L x L. The Hamiltonian is 


2N > 2 2N 


H= aes —¥c¢e;ln|9;,- 9; 


i=l i<j 


> 


where c; = +c, fori=1,---,N, and c;=—cy fori= N+1,--- ,2N, denote the charges 
of the particles; {a} and {pi} their coordinates and momenta, respectively. 


(a) Note that in the interaction term each pair appears only once, and there is no self- 
interaction i= 7. How many pairs have repulsive interactions, and how many have 
attractive interactions? 

(b) Write down the expression for the partition function Z(N, T, A) in terms of integrals 
over {a} and {pi}. Perform the integrals over the momenta, and rewrite the contri- 
bution of the coordinates as a product involving powers of {a}. using the identity 


et 
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(c) Although it is not possible to perform the integrals over {a} exactly, the dependence 
of Z on A can be obtained by the simple rescaling of coordinates, g;’ = q;/L. Use 
the results in parts (a) and (b) to show that Z x A2-BoN/2, 

(d) Calculate the two-dimensional pressure of this gas, and comment on its behavior at 
high and low temperatures. 

(e) The unphysical behavior at low temperatures is avoided by adding a hard core that 
prevents the coordinates of any two particles from coming closer than a distance a. 
The appearance of two length scales, a and L, makes the scaling analysis of part 
(c) questionable. By examining the partition function for N = 1, obtain an estimate 
for the temperature JT. at which the short distance scale a becomes important in 
calculating the partition function, invalidating the result of the previous part. What 
are the phases of this system at low and high temperatures? 


2k Ko ok ok 


5. Exact solutions for a one-dimensional gas: in statistical mechanics, there are very few 
systems of interacting particles that can be solved exactly. Such exact solutions are 
very important as they provide a check for the reliability of various approximations. A 
one-dimensional gas with short-range interactions is one such solvable case. 


(a) Show that for a potential with a hard core that screens the interactions from further 


neighbors, the Hamiltonian for N particles can be written as 
Np 3S 
H= > —+) V(x;—x;_))- 
X Im d ( i i ) 
The (indistinguishable) particles are labeled with coordinates {x;} such that 


O< x, <x) <-+:-< xy <L, 


where L is the length of the box confining the particles. 

(b) Write the expression for the partition function Z(T, N, L). Change variables to 6, = 
X,, 65 =X, —X,, °°, Oy =Xy —Xy_,, and carefully indicate the allowed ranges of 
integration and the constraints. 


(c) Consider the Gibbs partition function obtained from the Laplace transformation 
Z(T, N, P) = | dLexp(—BPL)Z(T, N, L), 
0 


and by extremizing the integrand find the standard formula for P in the canonical 
ensemble. 

(d) Change variables from L to 5y,; = L—\™_, 6,, and find the expression for 2(T, N, P) 
as a product over one-dimensional integrals over each 6,. 

(e) Ata fixed pressure P, find expressions for the mean length L(T, N, P), and the density 
n= N/L(T, N, P) (involving ratios of integrals that should be easy to interpret). 

Since the expression for n(T, P) in part (e) is continuous and non-singular for 

any choice of potential, there is in fact no condensation transition for the one- 
dimensional gas. By contrast, the approximate van der Waals equation (or the mean- 
field treatment) incorrectly predicts such a transition. 
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(f) For a hard-sphere gas, with minimum separation a between particles, calculate the 
equation of state P(T, n). Compare the excluded volume factor with the approximate 
result obtained in earlier problems, and also obtain the general virial coefficient 


B,(1). 
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6. The Manning transition: when ionic polymer (polelectrolytes) such as DNA are immersed 
in water, the negatively charged counter-ions go into solution, leaving behind a positively 
charged polymer. Because of the electrostatic repulsion of the charges left behind, the 
polymer stretches out into a cylinder of radius a, as illustrated in the figure. While thermal 
fluctuations tend to make the ions wander about in the solvent, electrostatic attractions 
favor their return and condensation on the polymer. If the number of counter-ions is NV, 
they interact with the N positive charges left behind on the rod through the potential 
U (r) = —2(Ne/L)\n(r/L), where r is the radial coordinate in a cylindrical geometry. 
If we ignore the Coulomb repulsion between counter-ions, they can be described by the 


classical Hamiltonian 


where n = N/L. 
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(a) For a cylindrical container of radius R, calculate the canonical partition function Z 
in terms of temperature T, density n, and radii R and a. 

(b) Calculate the probability distribution function p(r) for the radial position of a 
counter-ion, and its first moment (r), the average radial position of a counter-ion. 

(c) The behavior of the results calculated above in the limit R >> a is very different at high 
and low temperatures. Identify the transition temperature, and characterize the nature 
of the two phases. In particular, how does (r) depend on R and a in each case? 

(d) Calculate the pressure exerted by the counter-ions on the wall of the container, at 
r= R, in the limit R > a, at all temperatures. 

(e) The character of the transition examined in part (d) is modified if the Coulomb 
interactions between counter-ions are taken into account. An approximate approach 
to the interacting problem is to allow a fraction N, of counter-ions to condense 
along the polymer rod, while the remaining N, = N — N, fluctuate in the solvent. 
The free counter-ions are again treated as non-interacting particles, governed by the 


Hamiltonian 


2 
Pi 2 r 
H = +2e*n,In(=)], 
> E ee 

where n, = N,/L. Guess the equilibrium number of non-interacting ions, Ny, and 


justify your guess by discussing the response of the system to slight deviations from 
N;. (This is a qualitative question for which no new calculations are needed.) 


2k 2k 2K Kok ok ok 


7. Hard rods: a collection of N asymmetric molecules in two dimensions may be modeled 
as a gas of rods, each of length 2/ and lying in a plane. A rod can move by translation 
of its center of mass and rotation about the latter, as long as it does not encounter 
another rod. Without treating the hard-core interaction exactly, we can incorporate it 
approximately by assuming that the rotational motion of each rod is restricted (by the 
other rods) to an angle 0, which in turn introduces an excluded volume Q (6) (associated 
with each rod). The value of @ is then calculated self-consistently by maximizing the 
entropy at a given density n = N/V, where V is the total accessible area. 


excluded! 
volume / 
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(a) Write down the entropy of such a collection of rods in terms of N, n, ©, and A (6), 
the phase space volume associated with the rotational freedom of a single rod. (You 
may ignore the momentum contributions throughout, and consider the large N limit.) 

(b) Extremizing the entropy as a function of 6, relate the density to 0, A, and their 
derivatives Q’, A’; express your result in the form n = f (QO, A, 0’, A’). 

(c) Express the excluded volume 21 in terms of 0 and sketch f as a function of @ € [0, zr], 
assuming A « 0. 

(d) Describe the equilibrium state at high densities. Can you identify a phase transition 
as the density is decreased? Draw the corresponding critical density n, on your 
sketch. What is the critical angle 0, at the transition? You don’t need to calculate 
0, explicitly, but give an (implicit) relation defining it. What value does @ adopt at 
n<n,? 


2K 2k ok ok kK 


. Surfactant condensation: N surfactant molecules are added to the surface of water over 


an area A. They are subject to a Hamiltonian 


N32 
Pi 1 2 3 
H= —+-) V(r;,-7,), 
er aca 
where 7; and p; are two-dimensional vectors indicating the position and momentum of 
particle i. (This simple form ignores the couplings to the fluid itself. The actual kinetic 
and potential energies are more complicated.) 


(a) Write down the expression for the partition function Z(N, T, A) in terms of integrals 
over 7, and p;, and perform the integrals over the momenta. 

The interparticle potential V(r) is infinite for separations |r| < a, and attractive 
for |F| > a such that [™ 2ardrV(r) = —up. 

(b) Estimate the total non-excluded area available in the positional phase space of the 
system of N particles. 

(c) Estimate the total potential energy of the system, within a uniform density approx- 
imation n= N/A. Using this potential energy for all configurations allowed in the 
previous part, write down an approximation for Z. 

(d) The surface tension of water without surfactants is 0), approximately independent of 
temperature. Calculate the surface tension o(n, T ) in the presence of surfactants. 

(e) Show that below a certain temperature, T,, the expression for o is manifestly incor- 
rect. What do you think happens at low temperatures? 

(f) Compute the heat capacities, C,, and write down an expression for C, without 
explicit evaluation, due to the surfactants. 
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. Critical point behavior: the pressure P of a gas is related to its density n = N/V, and 


temperature T by the truncated expansion 


pee Pee 
= n—-—n'+—n’, 
8 2 6 


where b and c are assumed to be positive temperature-independent constants. 


10. 


Problems 


(a) Locate the critical temperature T, below which this equation must be invalid, and 
the corresponding density n, and pressure P.. of the critical point. Hence find the 
ratio kpT.n,/P.. 


(b) Calculate the isothermal compressibility k; = —{ % 


Vv a 


a and sketch its behavior as 
a function of T for n= n,. 

(c) On the critical isotherm give an expression for (P — P..) as a function of (n—7,). 

(d) The instability in the isotherms for T < T, is avoided by phase separation into a 


liquid of density n, and a gas of density n_. For temperatures close to T,, these 


densities behave as n, ~n,(1+64). Using a Maxwell construction, or otherwise, 
find an implicit equation for 6(7), and indicate its behavior for (T. —T ) > 0. (Hint. 
Along an isotherm, variations of chemical potential obey du = dP/n.) 


2k oR ook KK 


The binary alloy: a binary alloy (as in B brass) consists of N, atoms of type A, and Nz 
atoms of type B. The atoms form a simple cubic lattice, each interacting only with its six 
nearest neighbors. Assume an attractive energy of —J (J> 0) between like neighbors 
A—A and B-—B, but a repulsive energy of +J for an A— B pair. 


(a) What is the minimum energy configuration, or the state of the system at zero 
temperature? 

(b) Estimate the total interaction energy assuming that the atoms are randomly dis- 
tributed among the N sites; that is, each site is occupied independently with proba- 
bilities p, = N,/N and pz = N;/N. 

(c) Estimate the mixing entropy of the alloy with the same approximation. Assume 
N,,N,> 1. 

(d) Using the above, obtain a free energy function F(x), where x = (N, — Ng) /N. Expand 
F(x) to the fourth order in x, and show that the requirement of convexity of F breaks 
down below a critical temperature 7. For the remainder of this problem use the 
expansion obtained in (d) in place of the full function F(x). 

(e) Sketch F(x) for T> T., T=T,, and T < T,. For T < T, there is a range of compo- 
sitions x < |x,,(T )|, where F(x) is not convex and hence the composition is locally 
unstable. Find x,,(T ). 

(f) The alloy globally minimizes its free energy by separating into A-rich and B-rich 


phases of compositions +x,,(T ), where x,,(T ) minimizes the function F(x). Find 


Xpq(T ). 
(g) In the (7, x) plane sketch the phase separation boundary +x,,(T), and the so- 


called spinodal line +x,,(T ). (The spinodal line indicates onset of metastability and 


hysteresis effects.) 
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6 
Quantum statistical mechanics 


There are limitations to the applicability of classical statistical mechanics. The 
need to include quantum mechanical effects becomes especially apparent at 
low temperatures. In this chapter we shall first demonstrate the failure of 
the classical results in the contexts of heat capacities of molecular gases and 
solids, and the ultraviolet catastrophe in black-body radiation. We shall then 
reformulate statistical mechanics using quantum concepts. 


6.1 Dilute polyatomic gases 


Consider a dilute gas of polyatomic molecules. The Hamiltonian for each 
molecule of n atoms is 


Hy = YI + V (Gis +> In)> (6.1) 


where the potential energy V contains all the information on molecular bonds. 
For simplicity, we have assumed that all atoms in the molecule have the 
same mass. If the masses are different, the Hamiltonian can be brought into 
the above form by rescaling the coordinates g; by ,/m;,/m (and the momenta 
by ,/m/m;), where m, is the mass of the ith atom. Ignoring the interactions 
between molecules, the partition function of a dilute gas is 


n 


N 
ZY 1 [pe paa a ae 
Z(N) = =a fT pe P| BD 5, BUG da) |p - (6.2) 


N} 


The chemical bonds that keep the molecule together are usually quite 
strong (energies of the order of electron volts). At typical accessible tempera- 
tures, which are much smaller than the corresponding dissociation temperatures 
(~ 10*K), the molecule has a well-defined shape and only undergoes small 
deformations. The contribution of these deformations to the one-particle parti- 
tion function Z, can be computed as follows: 


(a) The first step is to find the equilibrium positions, (g7,...,q*), by minimizing the 


potential V. 


6.1 Dilute polyatomic gases 


(b) The energy cost of small deformations about equilibrium is then obtained by setting 


4; = 7* +u;, and making an expansion in powers of i, 


. 12 3 Vv é 
V=V4+= VY — Ua gt+ Ov’). (6.3) 
2 i,j=1 a,B=1 99;,094),p 
(Here i, j= 1,--- , n identify the atoms, and a, B = 1, 2, 3 label a particular component.) 


Since the expansion is around a stable equilibrium configuration, the first derivatives are 
absent in Eq. (6.3), and the matrix of second derivatives is positive definite, that is, it has 
only non-negative eigenvalues. 

(c) The normal modes of the molecule are obtained by diagonalizing the 3n x 3n matrix 
&V/ 4qi,«99;,g- The resulting 3n eigenvalues, {K,}, indicate the stiffness of each mode. 
We can change variables from the original deformations {u;} to the amplitudes {i,} 
of the eigenmodes. The corresponding conjugate momenta are {p, = mit,}. Since the 
transformation from {u;} to {u,} is unitary (preserving the length of a vector), 7; p;7 = 


>, p2, and the quadratic part of the resulting deformation Hamiltonian is 


3n 
aur a 

a= v4. | ps Sie], (6.4) 
= m 


(Such transformations are also canonical, preserving the measure of integration in phase 
space, [Jj duj.«4Pj,4 = I]; di,dp,.) 


The average energy of each molecule is the expectation value of the above 
Hamiltonian. Since each quadratic degree of freedom classically contributes a 
factor of k,7T/2 to the energy, 


3n+m 


(H,)=V*+ leah (6.5) 
Only modes with a finite stiffness can store potential energy, and m is defined 
as the number of such modes with non-zero K,. The following symmetries of 
the potential force some eigenvalues to be zero: 


(a) Translation symmetry: since V(q,; +¢, +++ 5G, +¢€) = V(GQy,°** + Jn), NO energy is stored 
in the center of mass coordinate 0 = >, g,/n, that is, V(O) = V(O+¢), and the 


corresponding three values of Kian; are Zero. 


trans 
(b) Rotation symmetry: there is also no potential energy associated with rotations of the 
molecule, and K,,, = 0 for the corresponding stiffnesses. The number of rotational modes, 
0 < r <3, depends on the shape of the molecule. Generally r = 3, except for a single 
atom that has r = 0 (no rotations are possible), and any rod-shaped molecule, which has 


r = 2 as a rotation parallel to its axis does not result in a new configuration. 


The remaining m = 3n —3—r eigenvectors of the matrix have non-zero 
stiffness, and correspond to the vibrational normal modes. The energy per 
molecule, from Eq. (6.5), is thus 


6n—3-r 


(Hy) = 2 


et (6.6) 
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Fig. 6.1 Temperature 
dependence of the heat 
capacity for a typical gas 
of diatomic molecules. 


Quantum statistical mechanics 


The corresponding heat capacities, 


(6n—3—r) (6n—1-r) 
= a kg, and Cp=Cyt+k,= ar 


are temperature-independent. The ratio y = Cp/C,, is easily measured in adia- 


C= kp, (6.7) 


batic processes. Values of y, expected on the basis of the above argument, are 
listed below for a number of different molecules. 


Monatomic He n=1 r=0 y=5/3 

Diatomic O, or CO n=2 r=2 y=9/7 

Linear triatomic O-C-O n=3 r=2 y = 15/13 

Planar triatomic y/o\4 n=3 r=3 y = 14/12 =7/6 
Tetra-atomic NH, n=4 r=3 y = 20/18 = 10/9 


1 10 100 1000 T(K) 


Measurements of the heat capacity of dilute gases do not agree with the 
above predictions. For example, the value Cy,/k, = 7/2, for a diatomic gas such 
as oxygen, is only observed at temperatures higher than a few thousand Kelvin. 
At room temperatures, a lower value of 5/2 is observed, while at even lower 
temperatures of around 10K, it is further reduced to 3/2. The low-temperature 
value is similar to that of a monatomic gas, and suggests that no energy is 
stored in the rotational and vibrational degrees of freedom. These observations 
can be explained if the allowed energy levels are quantized, as follows. 

Vibrational modes: a diatomic molecule has one vibrational mode with 
stiffness K = mw”, where w is the frequency of oscillations. The classical 
partition function for this mode is 


a dpdq Pp mw 
Zin = {i exp| 6(F+ F 


oe! 27m 27 \ 2m _ kpT 
iy (GP) (amor) = ipo ~ Ha 


(6.8) 


6.1 Dilute polyatomic gases 


where fi = h/27. The corresponding energy stored in this mode, 
dInZ__ din(Bho) _ 1 
ap op B 


comes from kp7/2 per kinetic and potential degrees of freedom. In quantum 


(Hyp) = =k,T, (6.9) 


mechanics, the allowed values of energy are quantized such that 
1 
Hi. =how (n+ 5): (6.10) 


with n =0,1,2,---. Assuming that the probability of each discrete level is 
proportional to its Boltzmann weight (as will be justified later on), there is a 
normalization factor 


4 food frosts /9) e Bho/2 
Zi =D e = {= =p (6.11) 
The high-temperature limit, 
1 kpT 
lim Z7,,=—— =~, 
poo vb Bho ho 


coincides with Eq. (6.8) (due in part to the choice of h as the measure of 
classical phase space). 
The expectation value of vibrational energy is 
dInZ hw a 
vib — = + 
ap 2 ' ap 


The first term is the energy due to quantum fluctuations that are present even 


—Bhw 


In (1—e-P**) = ne +ho- 7 


ae (6.12) 


in the zero-temperature ground state. The second term describes the additional 
energy due to thermal fluctuations. The resulting heat capacity, 


dE4 hw \* ~— eBho 
Ci. = vib , 6.13 
mw Or (7) (1 —e7Bho)2 oe) 
A Cyin/ke 


sy 


achieves the classical value of k, only at temperatures T >> 0,;,, where 0,i, = 
haw/k, is a characteristic temperature associated with the quanta of vibrational 
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Fig. 6.2 The contribution 
of (quantized) vibrations 
to the heat capacity. 


160 


Quantum statistical mechanics 


energy. For T < 6,,, C4, goes to zero as exp(—6,;,/T). Typical values of 6, 
are in the range of 10° to 10*K, explaining why the classical value of heat 
capacity is observed only at higher temperatures. 

Rotational modes: to account for the low-temperature anomaly in the 
heat capacity of diatomic molecules, we have to study the quantization of 
the rotational degrees of freedom. Classically, the orientation of a diatomic 
molecule is specified by two angles 0 and @, and its Lagrangian (equal to the 
kinetic energy) is 


ioe ; 
b=5 (+ sin’ f $) (6.14) 
where J is the moment of inertia. In terms of the conjugate momenta, 
0k : 0k ; 
=— =/06, = — =Isin’ 6 4, 6.15 
eer Po= ay p (6.15) 
the Hamiltonian for rotations is 
1 PS Fis 
i; 2 =— 6.16 
rot II (ni+ 4) 21 ( ) 


where L is the angular momentum. From the classical partition function, 


1 T 27 0° B - Ps 
=. | do | d / dp, d |p 
ror hh? Jo 0 $ _ Po OPg &XP 21 Pot sin’ 0 


(6.17) 
_ (2a1\ (40\ _ 2ksT 
~\ B Rr) RR? 
the stored energy is 
dinZ 0. (pr? 
Et) = — L =k,T. wl 
( cot op ap a( rr) BY? (6 8) 


as expected for two degrees of freedom. In quantum mechanics, the allowed val- 
ues of angular momentum are quantized to P= h?e(€+1) with €=0, 1,2,---, 
and each state has a degeneracy of 2€+ 1 (along a selected direction, L, = 
—f£,--.,+4£). A partition function is now obtained for these levels as 


Zi = > exp [ee] (2€+1)= aon je) (2€+1), (6.19) 
e=0 21 &=0 Tr 


where 0,,, = h?/(2Ik,) is a characteristic temperature associated with quanta 
of rotational energy. While the sum cannot be analytically evaluated in general, 
we can study its high- and low-temperature limits. 


(a) For T > 6,.,, the terms in Eq. (6.19) vary slowly, and the sum can be replaced by the 


integral 
e rot X(X + 1 
lim 244 = i dx(2x+1) exp [a] 
> oo 0 
(6.20) 
“ toy/t — 2 c 
= dy e. “rot. = = Loves 
0 rot 


that is, the classical result of Eq. (6.17) is recovered. 


6.2 Vibrations of a solid 


(b) For T < O,,,, the first few terms dominate the sum, and 
jim Zo, = 1A Be F/T 4 O(e~ Orot/7) (6.21) 


leading to an energy 


anZ_ a 


Ei, = ap 38 In[1+3e7*/7] =~ 6k gO, eM!” (6.22) 
The resulting heat capacity vanishes at low temperatures as 
dE‘, 26.4 \7 
Cam oaks (Fit) ewe, (6.23) 
r Crot/kp 


Typical values of 0,,, are between | and 10K, explaining the lower temperature shoulder 


rot 


in the heat capacity measurements. At very low temperatures, the only contributions come 
from the kinetic energy of the center of mass, and the molecule behaves as a monatomic 
particle. (The heat capacity vanishes at even lower temperatures due to quantum statistics, 
as will be discussed in the context of identical particles.) 


6.2 Vibrations of a solid 


Attractive interactions between particles first lead to condensation from a gas 
to liquid at low temperatures, and finally cause freezing into a solid state at 
even lower temperatures. For the purpose of discussing its thermodynamics, 
the solid can be regarded as a very large molecule subject to a Hamiltonian 
similar to Eq. (6.1), with n = N > 1 atoms. We can then proceed with the 
steps outlined in the previous section. 

(a) The classical ground state configuration of the solid is obtained by min- 
imizing the potential V. In almost all cases, the minimum energy corresponds 
to a periodic arrangement of atoms forming a Jattice. In terms of the three basis 


A 


vectors, a, b, and ¢, the locations of atoms in a simple crystal are given by 
q*(€,m,n) = [eat mb+ ne | =f, (6.24) 


where {£, m, n} is a triplet of integers. 
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Fig. 6.3 The contribution 
of (quantized) rotations to 
the heat capacity of a 
rod-shaped molecule. 
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Fig. 6.4 The Brillouin 
zone of a square lattice of 
spacing a. 
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(b) At finite temperatures, the atoms may undergo small deformations 
G=rtu(r), (6.25) 


with a cost in potential energy of 


Zo Pv bo 
V=V +3 ag bq pte) ug(F’) + O(u’). (6.26) 
ap 
(c) Finding the normal modes of a crystal is considerably simplified by its 
translational symmetry. In particular, the matrix of second derivatives only 


depends on the relative separation of two points, 
PV AS ones 
aa = Kap lt — 7”). (6.27) 

997,94" p 


It is always possible to take advantage of such a symmetry to at least partially 
diagonalize the matrix by using a Fourier basis, 


elk? 


Ugh) = > 
k JN 


it, (k). (6.28) 


The sum is restricted to wavevectors k inside a Brillouin zone. For example, in 
a cubic lattice of spacing a, each component of k is restricted to the interval 
[—a/a, w/a]. This is because wavevectors outside this interval carry no addi- 
tional information as (k,-+2am/a)(na) = k,(na)+2mnz, and any phase that 
is a multiple of 27 does not affect the sum in Eq. (6.28). 


—1/a t/a k, 


—1/a 


In terms of the Fourier modes, the potential energy of deformations is 


1 = oN) gikF> (7) aik > (T 
vai YS KapF—7) eta (k) et” tg (K’). (6.29) 
(7,7), (k,K) 
ap 
We can change variables to relative and center of mass coordinates, 


p=r-r, and R= a ; 


6.2 Vibrations of a solid 


by setting 


Equation (6.29) now simplifies to 


VaV+ x 23 (x —) (x Kup(P) eilk-K) 8/25, ita (k)itg(k »). (6.30) 


Kk! R 
ap 


As the sum in the first brackets is N6; 4h0° 


v= vrs > ba | jig (k)itg(— k) 
a me 


(6.31) 


=Vr4 ; Y Kapglh)ita(k)itg(k)*, 
k,a.B 


where Kug(k) = ds K.p(P) exp(ik - p), and itg(k)* = = ug(— k) is the complex 
conjugate of ig (k). 

The different Fourier modes are thus decoupled at the quadratic order, and 
the task of diagonalizing the 3N x 3N matrix of second derivatives is reduced 
to diagonalizing the 3 x 3 matrix Kup (k), separately for each k. The form of 
Kg is further restricted by the point group symmetries of the crystal. The 
discussion of such constraints is beyond the intent of this section and for 
simplicity we shall assume that K p(k) = 5,.~K (k) is already diagonal. (For 
an isotropic material, this implies a specific relation between bulk and shear 
moduli.) 

The kinetic energy of deformations is 


yi E Fie iar =E 5 PaO P.O. (6.32) 


5a ka 


where 


is the momentum conjugate to it, (k). The ies deformation Hamiltonian, 


pn ®) +O Ja 


Hare » =| a ite i. (®)| if (6.33) 


describes 3N independent harmonic oscillators of frequencies w,(k) = 
VV K(k)/m. 
In a classical treatment, each harmonic oscillator of non-zero stiffness con- 


tributes kT to the internal energy of the solid. At most, six of the 3N oscillators 
are expected to have zero stiffness (corresponding to uniform translations and 
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rotations of the crystal). Thus, up to non-extensive corrections of order 1/N, 
the classical internal energy associated with the Hamiltonian (6.33) is 3Nk,T, 
leading to a temperature-independent heat capacity of 3k, per atom. In fact, 
the measured heat capacity vanishes at low temperatures. We can again relate 
this observation to the quantization of the energy levels of each oscillator, as 
discussed in the previous section. Quantizing each harmonic mode separately 
gives the allowed values of the Hamiltonian as 


= 1 

HI=V*+> ho, (k) (mi. + ;) , (6.34) 
ka 

where the set of integers {nz ,} describes the quantum microstate of the oscil- 

lators. Since the oscillators are independent, their partition function 


74 = y eo BH" = e-BEo ll y eo Pliwalk)ng _ e BE Tl 1 
tea lp 
ka 


s — e-Bhoa(k) 
{nj 0) Lain re 


(6.35) 


is the product of single oscillator partition functions such as Eq. (6.11). (Eo 
includes the ground state energies of all oscillators in addition to V*.) 
The internal energy is 


E(1) = (H") = Ey + hgh) (n..(%)) (6.36) 
kia 


where the average occupation numbers are given by 


(n ) ee a in( 1 ) 
. og Bhiwa(k)n Oo Bhw.(k 1 —e-Bhoa(k) 
DP -0 ; (p Wa )) (6.37) 
eBhioa(k) 1 


1 —e-Phoak) — eBhoalk) — 1° 


As a first attempt at including quantum mechanical effects, we may adopt 
the Einstein model in which all the oscillators are assumed to have the same 
frequency w,. This model corresponds to atoms that are pinned to their ideal 
location by springs of stiffness K = 0?V/dq? = mw2. The resulting internal 
energy, 


HeReay eee 6.38 
— 0 + i= e—Bhog ? ( : ) 
and heat capacity, 
dE T,\? etl? 
C= — =3NK,(=) ———_,,, (6.39) 
dT T} (\—e-tlT) 


are simply proportional to that of a single oscillator (Eqs. (6.12) and (6.13)). In 
particular, there is an exponential decay of the heat capacity to zero with a char- 
acteristic temperature 7, = hw,/k,. However, the experimentally measured 
heat capacity decays to zero much more slowly, as T°. 

The discrepancy is resolved through the Debye model, which emphasizes 
that at low temperatures the main contribution to heat capacity is from the 


6.2 Vibrations of a solid 


oscillators of lowest frequency that are the most easily excited. The lowest 
energy modes in turn correspond to the smallest wave vectors k = ikl, or 
the longest wavelengths A = 27/k. Indeed, the modes with k=0 simply 
describe pure translations of the lattice and have zero stiffness. By continuity, 
we expect lim; _,, K (k) = 0, and ignoring considerations of crystal symmetry, 
the expansion of K (k) at small wavevectors takes the form 


K(k) = BR + 0(k’). 


The odd terms are absent in the expansion, since K (k) =K (—-k) follows from 
K(¥—r') = K(r’'—7f) in real space. The corresponding frequencies at long 


w(k) nee = vk, (6.40) 


where v = ./B/m is the speed of sound in the crystal. (In a real material, Kg 
is not proportional to 6,,, and different polarizations of sound have different 


wavelengths are 


velocities.) 
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Fig. 6.5 The heat capacity 
of a solid (gray line) goes 
to zero more slowly than 
in the Einstein model 
(solid line). 


Fig. 6.6 The dispersion of 
phonons in an isotropic 
crystal has different 
branches for longitudinal 
and transverse waves. 
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The quanta of vibrational modes are usually referred to as phonons. Using 
the dispersion relation in Eq. (6.40), the contribution of low-energy phonons 
to the internal energy is 
Auk 
vk 


(H") = Eq+)) Gi" (6.41) 
ina 


With periodic boundary conditions in a box of dimensions L, x L, x L,, the 
allowed wavevectors are 


> (2an, 2mn, 21, 
L,? Ly? L , 


x y z 


(6.42) 


where n,, n,, and n, are integers. In the large size limit, these modes are very 
densely packed, and the number of modes in a volume element d°k is 


dk. dk, dk, 


x 


N=— _—_ 
2m/L, 2n/Ly 2a/L, (27) 


bk = pd’k. (6.43) 


Using the density of states p, any sum over allowed wavevectors can be replaced 
by an integral as 


lim Yfke) = [ Pk ft). (6.44) 
k 


Hence, Eq. (6.41) can be rewritten as 


BZ Bk fuk 


ne 6.45 
(27)? ePhvk — | ( ) 


E=E,+3V / 
where the integral is performed over the volume of the Brillouin zone, and 
the factor of 3 comes from assuming the same sound velocity for the three 
polarizations. 

Due to its dependence on the shape of the Brillouin zone, it is not possible 
to give a simple closed form expression for the energy in Eq. (6.45). However, 
we can examine its high- and low-temperature limits. The characteristic Debye 
temperature separating the two limits, 


Tp _ maxw __. 7 (6.46) 


corresponds to the high-frequency modes at the edge of the zone. For T >> Tp, 
all modes behave classically. The integrand of Eq. (6.45) is just kg7T, and since 
the total number of modes is 3N = BV fe” d3k/(27)3, the classical results 
of E(T) = E,+3Nk,T and C = 3Nk, are recovered. For T < Tp, the factor 
exp(Bhvk) in the denominator of Eq. (6.45) is very large at the Brillouin zone 
edge. The most important contribution to the integral comes from small k, and 
the error in extending the integration range to infinity is small. After changing 


6.3 Black-body radiation 


variables to x = Bhv|k|, and using d°k = 47x? dx/(Bhv)} due to spherical 
symmetry, Eq. (6.45) gives 


873 \ hv er— 1 
: (6.47) 
ga ™ y( )\ ee 
~O' 10 VaAv) 8 


(The value of the definite integral, 7*/15 ~ 6.5, can be found in standard 
tables.) The resulting heat capacity, 


dE 27? (r) 


are Gr (6.48) 
has the form C « Nk, (T/ Ty in agreement with observations. The physical 
interpretation of this result is the following: at temperatures T << Tp, only a 
fraction of the phonon modes can be thermally excited. These are the low- 
frequency phonons with energy quanta hak) <k,T. The excited phonons 
have wavevectors Ik| < k*(T) © (kpT/hv). Quite generally, in d space dimen- 
sions, the number of these modes is approximately Vk*(T)? ~ V(k,T/hv)‘. 
Each excited mode can be treated classically, and contributes roughly k,T7 to the 
internal energy, which thus scales as E ~ V(k,T/hv)4k,T. The corresponding 
heat capacity, C ~ Vk,(k,T/hv)‘, vanishes as T“. 


6.3 Black-body radiation 


Phonons correspond to vibrations of a solid medium. There are also (longitu- 
dinal) sound modes in liquid and gas states. However, even “empty” vacuum 
can support fluctuations of the electromagnetic (EM) field, photons, which can 
be thermally excited at finite temperatures. The normal modes of this field 
are EM waves, characterized by a wavenumber k, and two possible polariza- 
tions a. (Since V- E =0 in free space, the electric field must be normal to k, 
and only transverse modes exist.) With appropriate choice of coordinates, the 
Hamiltonian for the EM field can be written as a sum of harmonic oscillators, 


1 os io > 
H = 53 [lira + ok? 
ka 


ap) 
it(k)| (6.49) 


with w,(k) = ck, where c is the speed of light. 

With periodic boundary conditions, the allowed wavevectors in a box of size 
Larek= 27(n,; ny, n.)/L, where {ris ny, n.} are integers. However, unlike 
phonons, there is no Brillouin zone limiting the size of k, and these integers 
can be arbitrarily large. The lack of such a restriction leads to the ultraviolet 
catastrophe in a classical treatment: as there is no limit to the wavevector, 
assigning kpT per mode leads to an infinite energy stored in the high-frequency 
modes. (The low frequencies are cut off by the finite size of the box.) It was 
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indeed to resolve this difficulty that Planck suggested the allowed values of 
EM energy must be quantized according to the Hamiltonian 


» 1 5 
HI =~ hek (+5). with n,(k)=0,1,2,--°. (6.50) 
fo 


As for phonons, the internal energy is calculated from 


1 e7 Blick 2V > hek 
= q\ — > ae = 3 
E=(H =2 nek (5+ om} Vite se) d k “Bick —]° (6.51) 


The zero-point energy is actually infinite, but as only energy differences are 
measured, it is usually ignored. The change of variables to x = Bhck allows 
us to calculate the excitation energy, 


E* fic (k,T +’ dx x? 
Vw \ fe 0 e—l 
2 ee 
ie Le, 
15 \ fc 


The EM radiation also exerts a pressure on the walls of the container. From 
the partition function of the Hamiltonian (6.50), 


= 7 1 e Bhck/2 
Z= T [exp [Broth (n4(E)+ )| =[l Sax (6.53) 


{ng (k)} ke k 


(6.52) 


the free energy is 


F= —k,TInZ= kT > | +In(1 -<mt)| 


; ne (6.54) 
ak [fick 
= Peace (baroks — a Bhck 
=2v | aa | 5 +ksTin(1—e )}: 
The pressure due to the photon gas is 
aF | dk 
P= = fick + 2kgT In(1—e 8" 
av |, Gays Vek + 2kaT in (Ie) 
kpT ¢® 
= Py- Be i] dk k? In (1 - a) (integrate by parts) 
WT Jo (6.55) 


k3 Bhce Prk 
3 1 —e-Bhek 


kpT ¢® 
=P)+ un | dk (compare with Eq. (6.51)) 
mT Jo 


Note that there is also an infinite zero-point pressure Py. Differences in this pres- 
sure lead to the Casimir force between conducting plates, which is measurable. 

The extra pressure of 1/3 times the energy density can be compared with 
that of a gas of relativistic particles. (As shown in the problem sets, a dispersion 
relation, E « |p|*, leads to a pressure, P = (s/d)(E/V) in d dimensions.) 


6.3 Black-body radiation 


Continuing with the analogy to a gas of particles, if a hole is opened in the 
container wall, the escaping energy flux per unit area and per unit time is 


b= le.) Z (6.56) 


All photons have speed c, and the average of the component of the velocity 
perpendicular to the hole can be calculated as 


1 1/2 . Cc 
(c,)=cx re [ 2 sin 0d6 cos 6 = re (6.57) 
resulting in 
1 E 2 kpl 
j= a (6.58) 


= c => — ‘ 
4 -V 60 Asc? 
The result, 6 = oT", is the Stefan—Boltzmann law for black-body radiation, 
and 
a kh 
° 60 Be? 
is Stefan’s constant. Black-body radiation has a characteristic frequency depen- 
dence: let E(T)/V = { dk€(k, t), where 
he kB 
E(k, T) = 2 ea 


is the energy density in wavevector k. The flux of emitted radiation in the 
interval [k, k+ dk] is I(k, T)dk, where 


~5.67x 10 °>Wm?K“4 (6.59) 


(6.60) 


he 8 eae /4ar for k  k*(T) 


: 
MT) = S88 = 5 See 


(6.61) 
[ fic?ke BP /4ar? for k >> k*(T). 


The characteristic wavevector k*(T) © k,T/hc separates quantum and classical 
regimes. It provides the upper cutoff that eliminates the ultraviolet catastrophe. 


4 I(k, T) 
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Fig. 6.7 The spectrum of 
black-body radiation from 
a system at 

temperature T. 
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6.4 Quantum microstates 


In the previous sections we indicated several failures of classical statistical 
mechanics, which were heuristically remedied by assuming quantized energy 
levels, while still calculating thermodynamic quantities from a partition sum 
Z=)>.,, exp (—BE,,). This implicitly assumes that the microstates of a quantum 
system are specified by its discretized energy levels, and governed by a prob- 
ability distribution similar to a Boltzmann weight. This “analogy” to classical 
statistical mechanics needs to be justified. Furthermore, quantum mechanics 
is itself inherently probabilistic, with uncertainties unrelated to those that lead 
to probabilities in statistical mechanics. Here, we shall construct a quantum 
formulation of statistical mechanics by closely following the steps that lead to 
the classical formulation. 

Microstates of a classical system of particles are described by the set of 
coordinates and conjugate momenta {p,, q;}; that is, by a point in the 6N- 
dimensional phase space. In quantum mechanics {gi} and {p;} are not inde- 
pendent observables. Instead: 


e The (micro-)state of a quantum system is completely specified by a unit 
vector |W), which belongs to an infinite-dimensional Hilbert space. The 
vector |’) can be written in terms of its components (n|), which are 
complex numbers, along a suitable set of orthonormal basis vectors |n). In 
the convenient notation introduced by Dirac, this decomposition is written as 


IW) = Di(nl®) In). (6.62) 

The most familiar basis is that of coordinates l{a,}). and ({a;} |v) = 
W(q,,.++>+4y) is the wave function. The normalization condition is 

(WP) =P |n) (nl) = 1, where (Wn) = (n|W)*. (6.63) 


For example, in the coordinate basis, we must require 
N 
(we) = fT] 6G MG...) P= 1 (6.64) 
i=1 


¢ Classically, various observables are functions O({p,, 4;}), defined in phase 
space. In quantum mechanics, these functions are replaced by Hermitian matri- 
ces (operators) in Hilbert space, obtained by substituting operators for {ai} and 
{p;} in the classical expression (after proper symmetrization of products, e.g., 
pq — (pq+4qp)/2). These basic operators satisfy the commutation relations, 


h 
[Pi de ] = Pit — HP] = F Sj (6.65) 
For example, in the coordinate basis | {q;}). the momentum operators are 


poss (6.66) 


6.4 Quantum microstates 


(Note that classical Poisson brackets satisfy { P} a} = —6;,. Quite generally, 
quantum commutation relations are obtained by multiplying the correspond- 
ing classical Poisson brackets by if.) 

e Unlike in classical mechanics, the value of an operator O is not uniquely 
determined for a particular microstate. It is instead a random variable, whose 
average in a state |W) is given by 

(0) = (VOW) = V2 (Ym) (m| On) (n|'¥). (6.67) 


For example, 
(UG) = [T] PAYG... yUUIPVG,---. Gy), and 
i=l 


KD) = [PIG dK ([FE}) WG. tu. 


To ensure that the expectation value (Q) is real in all states, the operators O 
must be Hermitian, that is, satisfy 


O'=0, where (m|O'|n) = (n|O|m)*. (6.68) 


When replacing p and q in a classical operator O({p;, q;}) by corresponding 
matrices, proper symmetrization of various products is necessary to ensure the 
above hermiticity. 

Time evolution of microstates is governed by the Hamiltonian A ({p,, q;}). 
A classical microstate evolves according to Hamilton’s equations of motion, 
while in quantum mechanics the state vector changes in time according to 


in WN) = H\V(2)). (6.69) 


A convenient basis is one that diagonalizes the matrix Fl. The energy 
eigenstates satisfy H(|n) = €,,|n), where €,, are the eigenenergies. Substituting 
|W(t)) = >>, (n|¥())|2) in Eq. (6.69), and taking advantage of the orthonor- 
mality condition (m|n) = 6,,,,, yields 


i€,,t 


2°) (nj 0). 


in (nH) = Ey(nIHO)), (nl) =ex (~ 


(6.70) 


The quantum states at two different times can be related by a time evolution 
operator, as 


|W(t)) = UC, to)|W(to)). (6.71) 


which satisfies ihd,U(t,t.) = HU(t,t,), with the boundary condition 
U(to, to) = 1. If Hl is independent of t, we can solve these equations to yield 


U(t, to) = exp |- *9¢(1 - n)| 4 (6.72) 
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6.5 Quantum macrostates 


Macrostates of the system depend on only a few thermodynamic functions. We 
can form an ensemble of a large number WV, of microstates w,, corresponding 
to a given macrostate. The different microstates occur with probabilities p,. 
(For example, p, = 1/N for an unbiased estimate in the absence of any other 
information.) When we no longer have exact knowledge of the microstate of a 
system, the system is said to be in a mixed state. 

Classically, ensemble averages are calculated from 


OULD; Gib) = YS PaO (Ha (0) = / [1 4@p,d°4,0 ({Bi, ait) p ({B;, Gi}. t) > (6.73) 
Qa i=l 
where 


N 
p ({Bi, Gi}: t) = > Pa Il eS (4 = Gi(t).) 5 (7; = Pilt)a) (6.74) 
a i=1 
is the phase space density. 
Similarly, a mixed quantum state is obtained from a set of possible states 
{|%,)}, with probabilities {p,}. The ensemble average of the quantum mechan- 
ical expectation value in Eq. (6.67) is then given by 


(0) = Pal ValOlVa) = 2 Pa(Valm)(n|¥q){m|O|n) 


a,m,n 


(6.75) 
= )-(n|p|m)(m|O|n) = tr(p0), 
where we have introduced a basis {|7)}, and defined the density matrix 
(n|p(t)|m) =D Pala Y(t) (Wa ()|m). (6.76) 


Classically, the probability (density) p(t) is a function defined on phase space. 
As all operators in phase space, it is replaced by a matrix in quantum mechanics. 
Stripped of the choice of basis, the density matrix is 


p(t) =) Pal ¥a()) (Vals): (6.77) 


Clearly, p corresponds to a pure state if and only if p? = p. 
The density matrix satisfies the following properties: 


(i) Normalization. Since each |‘V,) is normalized to unity, 


(1) =tr(p) = DUalp|n) = Y pal(al¥,)? =D Pa = 1. (6.78) 


a,n 


(ii) Hermiticity. The density matrix is Hermitian, that is, p* = p, since 
(m|p"|n) = (nlp|m)* = YY pa(Valm)(n| Vy) = (nlplm), (6.79) 


ensuring that the averages in Eq. (6.75) are real numbers. 


6.5 Quantum macrostates 


(iii) Positivity. For any |®), 
(P| p|) =P) pal P| Ya) (Val ®) = D2 Pal (P| Wa)? = 0. (6.80) 


Thus, p is positive definite, implying that all its eigenvalues must be positive. 
Liouville’s theorem gives the time evolution of the classical density as 


dp 0p 
— = — —{H, p}=0. 6.81 
Goa (6.81) 


It is most convenient to examine the evolution of the quantum density matrix 
in the basis of energy eigenstates, where according to Eq. (6.70) 


in a) =i Sry nl) 
= pa l(En— En) (nV) (alm) ] (6.82) 


= (n|(Hp—pHA)|m). 


The final result is a tensorial identity, and hence, independent of the choice of 
basis 


., 0 
ina p =[F, p]. (6.83) 


Equilibrium requires time-independent averages, and suggests dp/dot = 0. 
This condition is satisfied in both Eqs. (6.81) and (6.83) by choosing p = p(JL). 
(As discussed in chapter 3, p may also depend on conserved quantities {L,} 
such that [H, L,,] = 0.) Various equilibrium quantum density matrices can now 
be constructed in analogy with classical statistical mechanics. 

Microcanonical ensemble: as the internal energy has a fixed value E, a 
density matrix that includes this constraint is 
_ (HH —E) 


LC aay ae (6.84) 


In particular, in the basis of energy eigenstates, 


4 if €, =E, andm=n, 
(n|plm) = Q0 Pa (nl Va) (Va |m) = (6.85) 
a 0 if €,AE, omen. 


The first condition states that only eigenstates of the correct energy can appear 
in the quantum wave function, and that (for p, = 1/2) such states on average 
have the same amplitude, |(n|‘¥)|? = 1/Q. This is equivalent to the classical 
assumption of equal a priori equilibrium probabilities. The second (additional) 
condition states that the Q eigenstates of energy E are combined in a typical 
microstate with independent random phases. (Note that the normalization con- 
dition tr p = 1 implies that O(£) = >°,, 6(E — E,,) is the number of eigenstates 
of H with energy E.) 


173 


174 


Quantum statistical mechanics 


Canonical ensemble: a fixed temperature T = 1/k,8 can be achieved by 
putting the system in contact with a reservoir. By considering the combined 
system, the canonical density matrix is obtained as 


_ exp (—BH) 


p(B) = = Zip. « (6.86) 


The normalization condition tr(p) = 1 leads to the quantum partition function 
Z=tr fer) Os ePEn, (6.87) 


The final sum is over the (discrete) energy levels of H, and justifies the 
calculations performed in the previous sections. 

Grand canonical ensemble: the number of particles N is no longer fixed. 
Quantum microstates with indefinite particle number span a so-called Fock 
space. The corresponding density matrix is 


e-PBH+BuN 


p(B. n)==————, where (8, w) = tr(e-P 8H) = J ofH'7 (8). 
Q N=0 


(6.88) 
Example. Consider a single particle in a quantum canonical ensemble in a 
box of volume V. The energy eigenstates of the Hamiltonian 


2 


Seg h 
I= Poe ys (in coordinate basis), (6.89) 
2m 2m 


obtained from H|k) = E(k IK), are 


eik 3 . A2K2 
; ith E(k) = —. 
5; wi (k) i 


With periodic boundary conditions in a box of size L, the allowed values of 


(E|k) = (6.90) 


k are (277/L)(£,, £,, €,), where (£,, ,, €,) are integers. A particular vector in 
this one-particle Hilbert space is specified by its components along each of 
these basis states (infinite in number). The space of quantum microstates is 
thus much larger than the corresponding 6-dimensional classical phase space. 
The partition function for L > oo, 


= _ BRR) | Pk BRR 
Zz, =w(p)= Dew (2 =f Case oA 


k 


3 
Vv 2nmk,T\ _ V 
~ Qm3 he a 


(6.91) 


Problems 


coincides with the classical result, and A = h/,/27mk,T (justifying the use of 
d°p d?q/h? as the correct dimensionless measure of phase space). Elements of 
the density matrix in a coordinate representation are 


. . e BE) " RB Vabk enh: G-¥9) BR 
, je = aa: k k ee — pa 
Hole) = DG) — R= Ff env (-2 
k (6.92) 
1 m(x — x’)? 1 mx — x')? 
=F exp aphe = vy oxP 2 : 


The diagonal elements, (x|p|x}) = 1/V, are just the probabilities for finding 
a particle at x. The off-diagonal elements have no classical analog. They 
suggest that the appropriate way to think of the particle is as a wave packet 
of size A= h/,/27mk,T, the thermal wavelength. As T — oo, d goes to 
zero, and the classical analysis is valid. As T > 0, A diverges and quantum 
mechanical effects take over when A becomes comparable with the size of 
the box. 
Alternatively, we could have obtained Eq. (6.92), by noting that Eq. (6.86) 
implies 
2 
ae =-HZp= > vzZ0. (6.93) 
This is just the diffusion equation (for the free particle), which can be solved 
subject to the initial condition p(B = 0) = 1 (ie., (¥’|p(B = 0)|x) = B(X — 
x’)/V) to yield the result of Eq. (6.92). 


Problems for chapter 6 


1. One-dimensional chain: a chain of N +1 particles of mass m is connected by N massless 
springs of spring constant K and relaxed length a. The first and last particles are held 
fixed at the equilibrium separation of Na. Let us denote the longitudinal displacements 
of the particles from their equilibrium positions by {u;}, with uy = uy = 0 since the end 


particles are fixed. The Hamiltonian governing {u;}, and the conjugate momenta {p,}, is 


N-1 


> x N-2 
H= - 05 /a4E boar w | 
i=l 


i=) <7 


(a) Using the appropriate (sine) Fourier transforms, find the normal modes {iz,}, and the 
corresponding frequencies {w,}. 

(b) Express the Hamiltonian in terms of the amplitudes of normal modes {i,}, and 
evaluate the classical partition function. (You may integrate the {u;} from —oo to 
+00.) 

(c) First evaluate \il”), and use the result to calculate (u?). Plot the resulting squared 


displacement of each particle as a function of its equilibrium position. 
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(d) How are the results modified if only the first particle is fixed (u) = 0), while the 
other end is free (uy) 4 0)? (Note that this is a much simpler problem as the partition 
function can be evaluated by changing variables to the N — 1 spring extensions.) 


2K ok ok ok kK 


2. Black-hole thermodynamics: according to Bekenstein and Hawking, the entropy of a 


black hole is proportional to its area A, and given by 
a kpc 
~ 4Gh 


(a) Calculate the escape velocity at a radius R from a mass M using classical mechanics. 


S 


Find the relationship between the radius and mass of a black hole by setting this 
escape velocity to the speed of light c. (Relativistic calculations do not modify this 
result, which was originally obtained by Laplace.) 

(b) Does entropy increase or decrease when two black holes collapse into one? What is 
the entropy change for the Universe (in equivalent number of bits of information) 
when two solar mass black holes (M, ¥ 2 x 10°° kg) coalesce? 

(c) The internal energy of the black hole is given by the Einstein relation, E = Mc’. 
Find the temperature of the black hole in terms of its mass. 

(d) A “black hole” actually emits thermal radiation due to pair creation processes on its 
event horizon. Find the rate of energy loss due to such radiation. 

(e) Find the amount of time it takes an isolated black hole to evaporate. How long is 
this time for a black hole of solar mass? 

(f) What is the mass of a black hole that is in thermal equilibrium with the current 
cosmic background radiation at T = 2.7K? 

(g) Consider a spherical volume of space of radius R. According to the recently for- 
mulated Holographic Principle there is a maximum to the amount of entropy that 
this volume of space can have, independent of its contents! What is this maximal 
entropy? 


2K 2k ok ok kK 


3. Quantum harmonic oscillator: consider a single harmonic oscillator with the Hamiltonian 


(a) Find the partition function Z, at a temperature T, and calculate the energy (Hl). 

(b) Write down the formal expression for the canonical density matrix p in terms of the 
eigenstates ({|)}), and energy levels ({e,,}) of H. 

(c) Show that for a general operator A(x), 


La exp[A(x)] 4 eS exp[A(x)], unless E = —0, 
ax Ox Ox 


while in all cases 


tr {exp [A(x)]} = tr a exp [ac] . 


Problems 


(d) Note that the partition function calculated in part (a) does not depend on the mass m, 


that is, 0Z/dm = 0. Use this information, along with the result in part (c), to show 


that 
pP - mo’q 
2m] 2 [7 


(e) Using the results in parts (d) and (a), or otherwise, calculate (7). How are the results 


in Problem 1 modified at low temperatures by inclusion of quantum mechanical 
effects? 


(f) In a coordinate representation, calculate (q'|p|q) in the high-temperature limit. One 


approach is to use the result 


exp(BA) exp(BB) = exp[B(A+ B) + B’[A, B]/2+ 0(6°)]. 


(g) At low temperatures, p is dominated by low-energy states. Use the ground state 
wave function to evaluate the limiting behavior of (q'|p|q) as T — 0. 


(h) Calculate the exact expression for (q’|p|q). 
eR kk ok ok 


. Relativistic Coulomb gas: consider a quantum system of N positive, and N negative 


charged relativistic particles in a box of volume V = L?. The Hamiltonian is 


2N 2N ee; 
H=)> > clp\+>> > 3]? 
i=1 i<j 7,7; 


where e; = +e) fori=1,--- , N, and e,; = —ey fori=N-+1,--- ,2N, denote the charges 
of the particles; {F} and {p;} their coordinates and momenta, respectively. While this 


is too complicated a system to solve, we can nonetheless obtain some exact results. 


(a) Write down the Schrédinger equation for the eigenvalues ¢,(L), and (in coordinate 
space) eigenfunctions w, ({7;,}). State the constraints imposed on w(F}) if the 
particles are bosons or fermions. 

(b) By a change of scale 7,’ = 7,/L, show that the eigenvalues satisfy a scaling relation 
€,(L) = €,(1)/L. 

(c) Using the formal expression for the partition function Z(N, V, T), in terms of the 
eigenvalues {e,,(L)}, show that Z does not depend on T and V separately, but only 
on a specific scaling combination of them. 

(d) Relate the energy E£, and pressure P of the gas to variations of the partition function. 
Prove the exact result E = 3PV. 


(e 


wm 


The Coulomb interaction between charges in d-dimensional space falls off with sepa- 
d-2 : SP h ts : : 
| . (In d = 2 there is a logarithmic interaction.) In what dimen- 


ration as e,e,/ |7;— 7; 
sion d can you construct an exact relation between E and P for non-relativistic par- 
ticles (kinetic energy )°; p?/2m)? What is the corresponding exact relation between 


energy and pressure? 
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(f) Why are the above “exact” scaling laws not expected to hold in dense (liquid or 
solid) Coulomb mixtures? 


2K ok ok ok kK 


5. The virial theorem is a consequence of the invariance of the phase space for a system 
of N (classical or quantum) particles under canonical transformations, such as a change 
of scale. In the following, consider N particles with coordinates {a}. and conjugate 
momenta {p;} (with i= 1,--- ,N), and subject to a Hamiltonian 1 ({p;}, {G;}). 


(a) Classical version: write down the expression for the classical partition function, 
Z = Z[H]. Show that it is invariant under the rescaling g, > Aq,, Py > P,/A of 
a pair of conjugate variables, that is, Z[H(,] is independent of A, where A, is the 
Hamiltonian obtained after the above rescaling. 

(b) Quantum mechanical version: write down the expression for the quantum partition 
function. Show that it is also invariant under the rescalings g, > Aq, Py > P,/A, 
where p; and g; are now quantum mechanical operators. (Hint. Start with the time- 
independent Schrédinger equation.) 


(c) Now assume a Hamiltonian of the form 


x= TP +V((a). 


Use the result that Z[4(,] is independent of A to prove the virial relation 


Fr) 
—_]}=\>>-"%)> 
m 0q 


where the brackets denote thermal averages. 
(d) The above relation is sometimes used to estimate the mass of distant galaxies. The 
stars on the outer boundary of the G-8.333 galaxy have been measured to move with 


1 


velocity v ¥ 200kms~'. Give a numerical estimate of the ratio of the G-8.333’s 


mass to its size. 


2K ok ok ok kK 


6. Electron spin: the Hamiltonian for an electron in a magnetic field Bis 


2 01 0 -i 1 0 
H =—p,0.B, where o,= » C=]. : , and g,= 
10 : i 0 . 0-1 


are the Pauli spin operators, and jzz is the Bohr magneton. 


(a) In the quantum canonical ensemble evaluate the density matrix if B is along the z 
direction. 

(b) Repeat the calculation assuming that B points along the x direction. 

(c) Calculate the average energy in each of the above cases. 


2K 2k ok ok 2k GK 
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7. Quantum rotor: consider a rotor in two dimensions with 


hr a 
H = — FF ape’ and 0<6<2z7. 


(a) Find the eigenstates and energy levels of the system. 
(b) Write the expression for the density matrix (6’|p|@) in a canonical ensemble of 
temperature 7, and evaluate its low- and high-temperature limits. 


2k 2k ok a ok ok 


8. Quantum mechanical entropy: a quantum mechanical system (defined by a Hamiltonian 
AC), at temperature T, is described by a density matrix p(t), which has an associated 


entropy S(t) = —trp(t) In p(t). 


(a) Write down the time evolution equation for the density matrix, and calculate dS/dr. 

(b) Using the method of Lagrange multipliers, find the density operator p,,,, that maxi- 
mizes the functional S[p], subject to the constraint of fixed average energy (H) = 
trpH = E. 

(c) Show that the solution to part (b) is stationary, that is, 0p,,,,/dt = 0. 


2k Ko ok ook 


9. Ortho/para-hydrogen: hydrogen molecules can exist in ortho and para states. 


(a) The two electrons of H, in para-hydrogen form a singlet (antisymmetric) state. The 
orbital angular momentum can thus only take even values; that is, 


h2 
H, = —l(e+1), 
p= aft) 
where ¢ = 0, 2,4,---. Calculate the rotational partition function of para-hydrogen, 
and evaluate its low- and high-temperature limits. 


(b) In ortho-hydrogen the electrons are in a triply degenerate symmetric state, hence 


h2 
FH = — (e+ 1), 
0 = 57 e+ 1) 


with = 1,3,5,---. Calculate the rotational partition function of ortho-hydrogen, 
and evaluate its low- and high-temperature limits. 

(c) For an equilibrium gas of N hydrogen molecules calculate the partition function. 
(Hint. Sum over contributions from mixtures of N, para- and N, = N — N, ortho- 
hydrogen particles. Ignore vibrational degrees of freedom.) 

(d) Write down the expression for the rotational contribution to the internal energy 
(E,xot.)> and comment on its low- and high-temperature limits. 

Actually, due to small transition rates between ortho- and para-hydrogen, in most 


circumstances the mixture is not in equilibrium. 
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10. van Leeuwen’s theorem: Consider a gas of charged particles subject to a general Hamil- 


tonian of the form 


NS eS 9: 

Pi 2 2 

H= +U(G).°°*. Gy): 
dX ai (4 an) 


In an external magnetic field, B, the canonical momenta, p,,, are replaced with p,, — eA, 
where A is the vector potential, B= Vx A. Show that if quantum effects are ignored, 
the thermodynamics of the problem is independent of B. 
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Ideal quantum gases 


7.1 Hilbert space of identical particles 


In chapter 4, we discussed the Gibbs paradox for the mixing entropy of gases 
of identical particles. This difficulty was overcome by postulating that the 
phase space for N identical particles must be divided by N!, the number 
of permutations. This is not quite satisfactory as the classical equations of 
motion implicitly treat the particles as distinct. In quantum mechanics, by 
contrast, the identity of particles appears at the level of allowed states in 
Hilbert space. For example, the probability of finding two identical particles at 
positions Xx, and X,, obtained from the expectation value of position operators, 
is given by |W (x,, X5)|?, where V (x,, X,) is the state vector in the coordinate 
representation (i.e., the wave function). Since the exchange of particles 1 and 
2 leads to the same configuration, we must have |‘V (x,, X5)|? = |W (a, x,)|?. 
For a single-valued function, this leads to two possibilities! 


W(1,2)) =+|¥(2,1)), or (1, 2)) = —2, 1). (7.1) 


The Hilbert space used to describe identical particles is thus restricted to obey 
certain symmetries. 

For a system of N identical particles, there are N! permutations P, forming a 
group Sy. There are several ways for representing a permutation; for example, 
PI 23 4)= (3 24 1) for N = 4 can alternatively be indicated by 


' A complex phase is ruled out by considering the action of the operator E,,, which exchanges 
the labels 1 and 2. Since E;, = J, the identity operator, its squared eigenvalue must be unity, 
ruling out e'? unless @ = 0 or 7. This constraint is circumvented by anyons, which are 
described by multivalued wave functions with so-called fractional statistics. 
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Any permutation can be obtained from a sequence of two particle exchanges. 
For example, the above permutation is obtained by the exchanges (1,3) and 
(1,4) performed in sequence. The parity of a permutation is defined as 


("= +1. if P involves an even number of exchanges, e.g. (1 2 3) > (2 3 1) 
- |-1. if P involves an odd number of exchanges, e.g. (1 2 3) > (2 1 3) 


(Note that if lines are drawn connecting the initial and final locations of each 
integer in the above representation of P, the parity is (—1) raised to the number 
of intersections of these lines; four in the above example.) 

The action of permutations on an N-particle quantum state leads to a repre- 
sentation of the permutation group in Hilbert space. Requiring the wave func- 
tion to be single-valued, and to give equal probabilities under particle exchange, 
restricts the representation to be either fully symmetric or anti-symmetric. This 
allows for two types of identical particles in nature: 


(1) Bosons correspond to the fully symmetric representation such that 
PIW(,--+,N))=+1W(1,---,N)). 
(2) Fermions correspond to the fully anti-symmetric representation such that 
Plp(1,---.N)) = (-1)"|WUL,--- .N)). 


Of course, the Hamiltonian for identical particles must itself be symmetric, 
that is, PFC = H. However, for a given HF, there are many eigenstates with 
different symmetries under permutations. To select the correct set of eigenstates, 
in quantum mechanics the statistics of the particles (bosons or fermions) is 
specified independently. For example, consider N non-interacting particles in 
a box of volume V, with a Hamiltonian 


H=> HK 5 ( V2) (7.2) 
a=1 a=1 2m a , 


Each #, can be separately diagonalized, with plane wave states {|k)} and 
corresponding energies E(k) = A?k?/2m. Using sums and products of these 
one-particle states, we can construct the following N-particle states: 


(1) The product Hilbert space is obtained by simple multiplication of the one-body states, 
that is, 


ie ereee seat reed oe (7.3) 


7.1 Hilbert space of identical particles 


In the coordinate representation, 


7 . > 1 ee: Xs 
Gyo ull ado rea (1S bh) (7.4) 
and 
=" S NR 5 ie re 
HAlki,-+: kyle = oa ke lkKis-++ Ky de: (7.5) 
a=! 


But the product states do not satisfy the symmetry requirements for identical particles, 


and we must find the appropriate subspaces of correct symmetry. 


(2) The fermionic subspace is constructed as 
2 3 1 S 4 
Maser shy) = a= DCD" Plas kd» (7.6) 
-— P 


where the sum is over all N! permutations. If any one-particle label k appears more than 
once in the above list, the result is zero and there is no anti-symmetrized state. Anti- 
symmetrization is possible only when all the N values of ka are different. In this case, 
there are N! terms in the above sum, and N_ = N! is necessary to ensure normalization. 


For example, a two-particle anti-symmetrized state is 


(\k1, ky) — lhe, i) 
Ji 


(if not otherwise indicated, Ik, pitty ky) refers to the product state.) 


[ky ko)- = 


(3) Similarly, the bosonic subspace is constructed as 


1 zm 7 
eS Plug: (7.7) 


ihe 


In this case, there are no restrictions on the allowed values of k. A particular one-particle 


[ky,++* Ay) p= 


state may be repeated n; times in the list, with }°;; = N. As we shall prove shortly, 
proper normalization requires N, = N![]; n;!. For example, a correctly normalized three- 
particle bosonic state is constructed from two one-particle states |a), and one one-particle 
state |B) as (n, = 2, ng = 1, and N, = 3!2!1! = 12) 


_ l@)l@)1B) +1e)|B)le) +18) la) la) + le)|@)1B) + 1B) le) le) + la) 1B) la) 
|oaB), = Vin 
12 

1 


mE (la)|@)|B) +]@)|B)|@) +1B)|@)|@)). 


It is convenient to discuss bosons and fermions simultaneously by defining 


1 % +1 for bosons 
= —_ Yn’ Pi{k}), with n= | (7.8) 


{En = ae 
7 VN, P (-! for fermions 


with (+1)? = 1, and (—1)? used to indicate the parity of P as before. Each 
state is uniquely specified by a set of occupation numbers {nz}, such that 
7m = N, and 
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(1) For fermions, \{k})_ = 0, unless nz = 0 or 1, and N_ = NJ], nz! = M!. 


(2) For bosons, any k may be repeated nj; times, and the normalization is calculated from 


+ (BIE) 4 = = a, PUP) = a x DUP) 
M! i ny! 
aes 


(7.9) 
=1, 3 N,=N!J]nj!. 
k 


(The term ({k}|P{K}) is zero unless the permuted k’s are identical to the original set, 
which happens |]; n;! times.) 


7.2 Canonical formulation 


Using the states constructed in the previous section, we can calculate the 
canonical density matrix for non-interacting identical particles. In the coordinate 
representation we have 


(FHA) = LT an” UP Eyed) PHI (7.10) 


ky PP" 


where p({k}) = exp [—B(d_, Wk /2m)]/Zy. The sum pa ee is 
restricted to ensure that each identical particle state appears once and only once. 
In both the bosonic and fermionic subspaces the set of occupation numbers 
{nz} uniquely identifies a state. We can, however, remove this restriction from 
Eq. (7.10) if we divide by the resulting over-counting factor (for bosons) of 
NYV/UT n!). that is, 


: Ty nz! 

Lah N! ¢ 

{kK} tk} 
(Note that for fermions, the (—1)? factors cancel out the contributions from 
cases where any nj is larger than one.) Therefore, 


Ss 3 Th nz! 1 
({x ee NI NPigpml 
. pie (7.11) 
yo os Der #2) (an ED erm. 


In the limit of large volume, the sums over {k} can be replaced by integrals, 
and using the plane wave representation of wave functions, we have 


n? nl Bhek 
Zane [1 Tl Ge We os a 


P,P! 


({x}lel{x}) = 


+ * 7A2 
exp [iD Grea — kere #4) | : , 
VN 


x 


7.2 Canonical formulation 


We can order the sum in the exponent by focusing on a particular k-vector. 


Since ), f(Pa)g(a) = Vp f(B)g(P'B), where 8B = Pa and a = P“'B, we 
obtain 


eer 1 el Pky -ike-(p-19-%!)_ ) BR? /2m 
(i Helh) = sa En? ii] e i ea) | 


Zy(N!)? pp ee (27) 
(7.13) 
The Gaussian integrals in the square brackets are equal to 


1 TT /., _ 2 
73 xP v (Sta #4) . 


Setting B = P~'a in Eq. (7.13) gives 


zr 2 = 1 P,P’ T al 2 2 2 
(Le Fel} = ZyA2N (NI? a Ty exp EE (Xs — F159) . (7.14) 
Finally, we set Q = P’-'P, and use the results 7”? = yn” ', and n2 = 7” '? = 
n’ 7’, to get (after performing )~, = N!) 


ee 1 No 
(x lpl{x}) = ZI ea exp |-z > (Xg Fy) ; (7.15) 


B=1 
The canonical partition function, Z,, is obtained from the normalization 
condition 


w(p)=1, => fT] P%,({Elelf%}) =1, 
a=1 
as 


Fi = 1! au 32 Q ne ae 

"= yppw J Ta fad exp ~ 97 2 Ge Foe) : (7.16) 
The quantum partition function thus involves a sum over N! possible per- 
mutations. The classical result Z, = (V/ yr /N! is obtained from the term 
corresponding to no particle exchange, Q = 1. The division by M! finally justi- 
fies the factor that was (somewhat artificially) introduced in classical statistical 
mechanics to deal with the phase space of identical particles. However, this 
classical result is only valid at very high temperatures and is modified by the 
quantum corrections coming from the remaining permutations. As any permu- 
tation involves a product of factors exp[—7(x, —X,)?/A7], its contributions 
vanish as A > 0 for T > ov. 

The lowest order correction comes from the simplest permutation, which is 
the exchange of two particles. The exchange of particles | and 2 is accompanied 
by a factor of nexp[—27(x, — X,)?/A?]. As each of the possible M(N — 1)/2 
pairwise exchanges gives the same contribution to Z,, we get 


1 es NN - 
Zu = wigw f T1e°5e{1+ , 


~nexp| Ta abooe (7.17) 
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Fig. 7.1 The effective 
classical potential that 
mimicks quantum 
correlations at high 
temperatures is attractive 
for bosons, and repulsive 
for fermions. 
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For any a > 3, [ d°x, = V; in the remaining two integrations we can use the 
relative, 7, =X —X,, and center of mass coordinates to get 


1 NN -1 . 2 
Zy v% E we) nf PF ernie +] 


~ NIABN 


” 3 (7.18) 
2h FY 1 N=) [2ar2 . 
~ Nas 2V 4 } 
From the corresponding free energy, 
e V] kgTN? »3 
F=—kgTInZy =—NkyTIn] | yr es (7.19) 


the gas pressure is computed as 
OF | — NkgT N?kgT 
vi, Vv ye BP 


3 


na 
as 


P= ns--= kg nee], (7.20) 


Note that the first quantum correction is equivalent to a second virial coef- 
ficient of 


nd? 
By = — sey: G21) 
The resulting correction to pressure is negative for bosons, and positive for 
fermions. In the classical formulation, a second virial coefficient was obtained 
from a two-body interaction. The classical potential V(r) that leads to a virial 


series for the partition function as in Eq. (7.17) is obtained from 


f() = e BVO) i ne —_ 
72/02 44 j93 (7.22) 
V(r) =—kgT In [! + ee me —kpTne 2” 


(The final approximation corresponds to high temperatures, where only the first 
correction is important.) Thus the effects of quantum statistics at high tem- 
peratures are approximately equivalent to introducing an interaction between 
particles. The interaction is attractive for bosons, repulsive for fermions, and 
operates over distances of the order of the thermal wavelength A. 


4 V(r) 


, fermions 


des 


7.3 Grand canonical formulation 


7.3 Grand canonical formulation 


Calculating the partition function by performing all the sums in Eq. (7.16) is a 
formidable task. Alternatively, we can compute Z, in the energy basis as 


/ N / 
Zy =tr er) =)" exp | » et = >> exp [exec . (7.23) 
{ka} a=! {ng} k 
These sums are still difficult to perform due to the restrictions of symmetry on 
the allowed values of k or {n;}: the occupation numbers {n;} are restricted to 
ym = N, and nj = 0,1,2,--- for bosons, while nz = 0 or | for fermions. 
As before, the first constraint can be removed by looking at the grand partition 
function, 


OAT, py= > eP" > exp E ye 
N=0 {nz} k 


; (7.24) 
=> []exp [-B(e® —n)n; | : 
{ng} 


The sums over {nz} can now be performed independently for each k, subject 
to the restrictions on occupation numbers imposed by particle symmetry. 


e For fermions, nz = 0 or 1, and 


oO =] [1 +exp (Bu — pe(e)| (7.25) 
k 
e For bosons, nz = 0, 1,2,---, and summing the geometric series gives 
> -1 
2,=T] [1 — exp (Bu pe(k)) | (7.26) 
k 
The results for both cases can be presented simultaneously as 
In2,=—n)> In [1 —nexp (Bu - Bee) ], (7.27) 
k 
with 7 = —1 for fermions, and 7 = +1 for bosons. 


In the grand canonical formulation, different one-particle states are occupied 
independently, with a joint probability 


a 1 2 
P, ({r®}) =3 Texp| B(E(R) u)n; | (7.28) 
1k 
The average occupation number of a state of energy € (k) is given by 
dlnQ 1 
(n;),= _— (7.29) 


A(BE(K)) — z-teBEW — 
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where z = exp(Gw). The average values of the particle number and internal 
energy are then given by 


[ =Litw)y= Leo 


(7.30) 


| E 1 LEW) y= es ——+—- 


7.4 Non-relativistic gas 


Quantum particles are further characterized by a spin s. In the absence of 
a magnetic field, different spin states have the same energy, and a spin 
degeneracy factor, g = 2s+1, multiplies Eqs. (7.27)-(7.30). In particular, 
for a non-relativistic gas in three dimensions (€ (k) = h?k?/2m, and )); > 
Via k/(27)3) these equations reduce to 


InQ, ak Bh2k? 

P In| 1 = 
- mv =n | (2m)° “| neexp( 2m )]: 
ie / Pk 1 

=g : 
2m)3 Re 
i ane (E> )-1 (7.31) 
| / BE nA 1 

tor ae 
| “=v ~ 8) Gap am (ee) 

{ ~rexp{ ——— ]- 
2m 


To simplify these equations, we change variables to x = Bh?k?/(2m), so that 


1/2 1/2 
k= vont in — oe. = dk= waa Mas. 


Substituting into Eqs. (7.31) gives 


Aq? 
[ hy =—n 5 ua /- dx x'/? In(1— ze) 
| an (integration b ts) 
integration by parts), 

a. aa = 
| deal (7.32) 
| Mn = a —Tex 9’ 
| ge 2 pe dxx3? 
| Ben =35 —lex ; 

Vaso ztee— 9 


7.4 Non-relativistic gas 


We now define two sets of functions by 


| co dx x7! 
N(z)= : 7.33 
AO erses yf Mee rece (7.33) 


For non-integer arguments, the function m! = I'(m-+ 1) is defined by the integral 
fy dxx™ e*. In particular, from this definition it follows that (1/2)! = /7/2, 
and (3/2)! = (3/2)./7/2. Equations (7.32) now take the simple forms 


[ BP, = aft) 


g 
Ny = fa) (7.34) 
| 3 
E, = zh a 


These results completely describe the thermodynamics of ideal quantum gases 
as a function of z. To find the equation of state explicitly in the form P,,(n,, T ) 
requires solving for z in terms of density. To this end, we need to understand 
the behavior of the functions f(z). 
The high-temperature, low-density (non-degenerate) limit will be examined 
first. In this limit, z is small and 
1 ec dx xm! 1 2 
7 = = d m—1 xy (JV — —x\-l 
m(2) (m—1)! i zte*—y (m-—1)! : a 
= 1 
~ (m—1)! 


| dx x7! > (ze~*)* yt! 
0 a=1 


= s ttle 1 [ dx x I_-ax 
(m—1)! Jo 


co a 2 3 4 

Paar z z z 

= as — 7.35 
q am z+ 15m + 3m ae 14m “F ( ) 


We thus find (self-consistently) that f(z), and hence n,(z) and P,(z), are 
indeed small as z > 0. Equations (7.34) in this limit give 


3 2 3 4 
nA _ £0 -_ z z Zz 
[ =hpO=zt+ Isat patigat > 


(7.36) 
BP, 2 2 ZA 
=fspO=2+ nt 3a + Iga ts 


The first of the above equations can be solved perturbatively, by the recursive 
procedure of substituting the solution up to a lower order, as 


n° 2 2 
"53/2 — 33/2 


& 
= n,° n n,d : 

n,? n n° : 1 1 nd?’ : 
~ g 23/2 g + 4 33/2 g 


Z= 
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Substituting this solution into the second leads to 
2 3 
BP, _ n,M n n,° a 1 1 n° 
g g 93/2 g 4 33/2 g 
2 3 3 
nl n n,\ 1 n° a. 1 n° - 
25/2 g 8 g 35/2 g 


The pressure of the quantum gas can thus be expressed in the form of a virial 
expansion, as 


3 3\? 
7 n [nA 1 2 n,A 
P, = Myke | 1 25/2 ( g cg G 35/2 2 aoa (7.38) 


The second virial coefficient B, = —yA?/(2°/g) agrees with Eq. (7.21) com- 
puted in the canonical ensemble for g = 1. The natural (dimensionless) expan- 
sion parameter is n,r° /g, and quantum mechanical effects become important 
when nr? > g; in the so-called quantum degenerate limit. The behavior of 
fermi and bose gases is very different in this degenerate limit of low tempera- 
tures and high densities, and the two cases will be discussed separately in the 
following sections. 


7.5 The degenerate fermi gas 
At zero temperature, the fermi occupation number, 
1 


(nj) == > 
 BlEW-u) 4 1 


(7.39) 


is one for € (k) <p, and zero otherwise. The limiting value of mw at zero 
temperature is called the fermi energy, E,,, and all one-particle states of energy 
less than €, are occupied, forming a fermi sea. For the ideal gas with € (k) a 
h?k? /(2m), there is a corresponding fermi wavenumber k,, calculated from 


k<kp Bk V 
N=) (2s+1)=av [ on = eek. (7.40) 
k\<kp 
In terms of the density n = N/V, 
67 1/3 ae he (69 2/3 
kr =( =) < = oye ( =) an) 
g ~ Im \~g 


Note that while in a classical treatment the ideal gas has a large density of 
states at T= 0 (from Oegiassicaa « VY /N!), the quantum fermi gas has a unique 
ground state with Q = 1. Once the one-particle momenta are specified (all k for 
[k| <k,-), there is only one anti-symmetrized state, as constructed in Eq. (7.6). 
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Anz) Fig. 7.2 The fermi 
distribution for 
occupation numbers, at 
zero (dotted), and finite 
(solid) temperatures. 
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To see how the fermi sea is modified at small temperatures, we need the 
behavior of f- (z) for large z, which, after integration by parts, is 


fn (= fax *(=S5). 


Since the fermi occupation number changes abruptly from one to zero, its 
derivative in the above equation is sharply peaked. We can expand around 
this peak by setting x =Inz++t, and extending the range of integration to 
—o <t< +o, as 


fal =f dr anton (SS = ) 


e'+1 
i aes df -1 
=—/ dt ( ) t* (Inz)"* — 
al. du a) Ming) (9) (7.42) 
(Inz)” = m! _ d / —-l 
= 1 “dt — , 
mo eee ak di e+ 


Using the (anti-)symmetry of the integrand under t > —t, and undoing the 
integration by parts, yields 


1 =, a 4 ) 0 for @ odd, 


— t f*— | —— eat 
al Jo dt \e'+1 =2f7(1) _ for a even. 


dt 
eat e+ 


Inserting the above into Eq. (7.42), and using tabulated values for the integrals 
f,, (1), leads to the Sommerfeld expansion, 


lim fg (@) == Yo fs (1) Gey ine) 
_ (Inz)” m m(m—1)  72* m(m—1)(m—2)(m—3) 
am! 1 +e (na? 1 360 (Inz)4 os | 


(7.43) 


In the degenerate limit, the density and chemical potential are related by 


nd3 1 3/2 
= fal) = Fo 


7 3 
1 1 1. 7.44 
| + 622 Y ag +: -]> ( ) 
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Fig. 7.3 The function foe) 
f32(2) determines the _ 
chemical potential pw. 


NY 


The lowest-order result reproduces the expression in Eq. (7.40) for the fermi 
energy, 


3 2/3 R2 2,\ 2/3 
a 3 - _B 6m-n = Be;. 
T>0 4/7 8 2m 8 


Inserting the zero-temperature limit into Eq. (7.44) gives the first-order correction, 


. 2/3 
tT (kpT\~ wm (k,T\? 
Inz= 1a {2 ase = 1a f= wel. (74 
nz Ber + 8 (“*) + Be, 1D (“*) + (7.45) 


Fig. 7.4 Temperature fan 
dependence of the . 
chemical potential for a 

fermi gas. 


The appropriate dimensionless expansion parameter is (k,7/€,-). Note that the 
fermion chemical potential 4 = k,T1nz is positive at low temperatures, and 
negative at high temperatures (from Eq. (7.37)). It changes sign at a temperature 
of the order of €,-/k,, set by the fermi energy. 

The low-temperature expansion for the pressure is 


(ny 2+] 


g g (Inz)/? wT 5 3 
BP =~; fspl2) = 1 


MB (5/2)! 6 22 
_ g 8(BE;)°? 5 w (kgT\’ 5m (kgT\’ 
“15 Sa [ 2 12 ({") +] ce ({") Fo | (7.46) 


S cfm y 
=BP,|1+—72( 25 sets 
B | ig" () : 
where P,; = (2/5)n€, is the fermi pressure. Unlike its classical counterpart, 
the fermi gas at zero temperature has finite pressure and internal energy. 
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4 P/P Fig. 7.5 Temperature 
dependence of the 
pressure of a fermi gas. 
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The low-temperature expansion for the internal energy is obtained easily 
from Eq. (7.46) using 


E 3. 3 5 T\? 
= = =P = =nk,T, | 1+—7 | — ee he TAT 
V2 Sotat,| 4? ( )+ Ce) 


where we have introduced the fermi temperature T, = €,/k,. Equation (7.47) 
leads to a low-temperature heat capacity, 


dE wr? T T\? 
Cy = aa = Ma 7) +0 . (7.48) 
F 


dT i 


Fig. 7.6 Temperature 
dependence of the heat 
capacity of a fermi gas. 


The linear scaling of the heat capacity as T — 0 is a general feature of 
a fermi gas, valid in all dimensions. It has the following simple physical 
interpretation: the probability of occupying single-particle states, Eq. (7.39), 
is very close to a step function at small temperatures. Only particles within a 
distance of approximately k,T of the fermi energy can be thermally excited. 
This represents only a small fraction, T/7,, of the total number of fermions. 
Each excited particle gains an energy of the order of k,7, leading to a change 
in the internal energy of approximately k,7N(T/T,). Hence the heat capacity 
is given by Cy = dE/dT ~ NkgT/T;. This conclusion is also valid for an 
interacting fermi gas. 
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The fact that only a small number, M(7/T;), of fermions are excited at small 
temperatures accounts for many interesting properties of fermi gases. For exam- 
ple, the magnetic susceptibility of a classical gas of N non-interacting particles 
of magnetic moment pz follows the Curie law, vy « Nuz/(k,T ). Since quan- 
tum mechanically, only a fraction of spins contributes at low-temperatures, the 
low-temperature susceptibility saturates to a (Pauli) value of y « Nuz/(kgTp). 
(See the problems for details of this calculation.) 


7.6 The degenerate bose gas 
The average bose occupation number, 

1 
exp[B(é(®)—H)]-1 


(nz), = (7.49) 


must certainly be positive. This requires € (k) — p to be positive for all k, and 
hence w < min [ew]. = 0 (for €(k) = h?k2/2m). At high temperatures (classi- 
cal limit), ps is large and negative, and increases toward zero like kT In(nA3/g) 
as temperature is reduced. In the degenerate quantum limit, approaches its 
limiting value of zero. To see how this limit is achieved, and to find out 
about the behavior of the degenerate bose gas, we have to examine the lim- 
iting behavior of the functions f*(z) in Eqs. (7.34) as z = exp(By) goes to 
unity. 

The functions f*(z) are monotonically increasing with z in the interval 


m 


0<z<1. The maximum value attained at z = | is given by 


m—1 


Q=20=— f S 


(m—1)! e—1¢ cn) 


The integrand has a pole as x > 0, where it behaves as f dxx”~*. Therefore, 


é, 18 finite for m > 1 and infinite for m < 1. A useful recursive property of 
these functions is (for m > 1) 


d co xml d 1 
opt = d 
agin @) I “Gn — 1)! dz (sa :) 


d -1,%x e / 1d —1,%x 
(we Erte) =-Sr =F ase) 
(7.51) 

_ 1 ey xml d 1 . ‘ 
= [ x oles (lea (integrate by parts) 

1 food x2 1 1 
=— d. => + re 

a) x (m—2)! ze* — 1 7 Fn—1(@) 


Hence, a sufficiently high derivative of f(z) will be divergent at z = 1 for 
all m. 
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The density of excited states for the non-relativistic bose gas in three dimen- 
sions is thus bounded by 


& x» & 
n= 43 f3/2(2) sn= 3/2 (7.52) 
At sufficiently high temperatures, such that 
x h \ 
n n 1 
= ——. } <¢,,,%2.612---, 7.53 
g 8 (tes) ue ae 


this bound is not relevant, and n,, = n. However, on lowering temperature, the 
limiting density of excited states is achieved at 


h ( n ) 
2amkp 8632 , 


For T < T., z gets stuck to unity (uw = 0). The limiting density of excited states, 
n* = g¢3,)/* x T*, is then less than the total particle density (and independent 
of it). The remaining gas particles, with density ny =n—n*, occupy the lowest 


T,(n) = (7.54) 


energy state with k = 0. This phenomenon, of a macroscopic occupation of a 
single one-particle state, is a consequence of quantum statistics, and known as 
Bose-Einstein condensation. 
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Fig. 7.7 Graphical 
calculation of the 
fugacity of a 
three-dimensional ideal 
bose gas. 


Fig. 7.8 Temperature 
dependence of the 
thermally excited bose 
particle density (solid 
line). For T< T,(n), the 
remaining density 
occupies the ground 
state (dashed line). 
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Fig. 7.9 Temperature 
dependence of the 
pressure of the bose gas, 
at two densities n, < np. 
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The bose condensate has some unusual properties. The gas pressure for 
T<T,, 


a 


a (7.55) 


g 8, 

pP= sp fs2) = 5p 652 ~ 1.341 

vanishes as T°? and is independent of density. This is because only the excited 

fraction n* has finite momentum and contributes to the pressure. Alternatively, 

bose condensation can be achieved at a fixed temperature by increasing density 

(reducing volume). From Eq. (7.53), the transition occurs at a specific volume 
1 - 


v — ‘ (7.56) 
n* 8632 


For v < v*, the pressure—volume isotherm is flat, since dP/dv « dP/dn = 0 from 
Eq. (7.55). The flat portion of isotherms is reminiscent of coexisting liquid 
and gas phases. We can similarly regard bose condensation as the coexistence 
of a “normal gas” of specific volume v*, and a “liquid” of volume 0. The 
vanishing of the “liquid” volume is an unrealistic feature due to the absence of 
any interaction potential between the particles. 

Bose condensation combines features of discontinuous (first-order), and 
continuous (second-order) transitions; there is a finite latent heat while the 
compressibility diverges. The latent heat of the transition can be obtained from 
the Clausius—Clapeyron equation, which gives the change of the transition 
temperature with pressure as 


T A T.(v* — 
as 28V Fe a): (7.57) 
dP Coexistence AS L 
Since Eq. (7.55) gives the gas pressure right up to the transition point, 
dP SP 
a ==. (7.58) 


dT | Coexistence 
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Fig. 7.10 Isotherms of 
the bose gas at two 
temperatures T, < 7). 


Using the above equations we find a latent heat, 


_ dP 5 5g g, \" 
= = aT Coexistence ke ie 2 ° qstonkel -(Gs4e) 
- (7.59) 
= Lak, © 1.28k,T, 
2 £3/2 


To find the compressibility x; = dn/dP|, /n, take derivatives of Eqs. (7.34), 
and take advantage of the identity in Eq. (7.51) to get 


dP ue) Tl 
i oe . efile) 
; (7.60) 
dn £ 1 
es i aa ttl 1/2 (z) 
The ratio of these equations leads to 
+ 
_ fin) (7.61) 
nk Tf 3/2 (z) 


which diverges at the transition since lim._, , Fin (z) —> oo, that is, the isotherms 
approach the flat coexistence portion tangentially. 
From the expression for energy in the grand canonical ensemble, 
3 3 
E= ps a ve kT f5i0(z) x T°? feio(Z)s (7.62) 


and using Eq. (7.51), the heat capacity is obtained as 


dE 3. ¢ 5 1 dz 
= pl a — fz a ‘ As 
Cyn ra ee 5 5ake [Frho+ 7p) ar nl (7.63) 
The derivative dz/d7T|,, , is found from the condition of fixed particle number, 
using 
dN oe en 1, dz 
—| =0=2y|— = — ; 7.64 
dr|, 0 fv rites zfip&) ar a (7.64) 


Substituting the solution 


T dz 
z dT \yy 
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Fig. 7.11 Heat capacity of 
the bose gas has a cusp 
at T,. 
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into Eq. (7.63) yields 


Cy 3 g 


(7.65) 


_ 5 3 Fain (zy? 
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Expanding the result in powers of z indicates that at high temperatures the heat 
capacity is larger than the classical value; Cy /Nk, = 3/2[1 +nd3/27/? +---]. 
At low temperatures, z = | and 


Cy 15 g 15 £5/2 ( T i" 


Nkp 4 0B? 40, \ 7, 


(7.66) 


The origin of the T?/* behavior of the heat capacity at low temperatures 
is easily understood. At T = 0 all particles occupy the k =0 state. At small 
but finite temperatures there is occupation of states of finite momentum, up to 
a value of approximately k,, such that h?k?,/2m =k,T. Each of these states 
has an energy proportional to kpT. The excitation energy in d dimensions is 
thus given by E,, « Vk4k,T. The resulting heat capacity is Cy « Vk,T“/”. The 
reasoning is similar to that used to calculate the heat capacities of a phonon 
(or photon) gas. The difference in the power laws simply originates from 
the difference in the energy spectrum of low-energy excitations (E(k) a k? 
in the former and €(k) « k for the latter). In both cases the total number of 
excitations is not conserved, corresponding to wz = 0. For the bose gas, this lack 
of conservation only persists up to the transition temperature, at which point all 
particles are excited out of the reservoir with 4 = 0 at k=0. Cy is continuous 
at T., reaching a maximum value of approximately 1.92k, per particle, but has 
a discontinuous derivative at this point. 


7.7 Superfluid He* 


Interesting examples of quantum fluids are provided by the isotopes of helium. 
The two electrons of He occupy the Is orbital with opposite spins. The filled 
orbital makes this noble gas particularly inert. There is still a van der Waals 
interaction between two He atoms, but the interatomic potential has a shallow 
minimum of depth 9K at a separation of roughly 3A. The weakness of this 
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Fig. 7.12 Schematic 
phase diagram of He* 
with a phase transition 
between normal and 
superfluid forms of the 
liquid. 


Ph 


26 atm 
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interaction makes He a universal wetting agent. As the He atoms have a stronger 
attraction for practically all other molecules, they easily spread over the surface 
of any substance. Due to its light mass, the He atom undergoes large zero-point 
fluctuations at T = 0. These fluctuations are sufficient to melt a solid phase, 
and thus He remains in a liquid state at ordinary pressures. Pressures of over 
25 atmospheres are required to sufficiently localize the He atoms to result in 
a solid phase at T = 0. A remarkable property of the quantum liquid at zero 
temperature is that, unlike its classical counterpart, it has zero entropy. 


——— Fig. 7.13 Evaporative 
Pump vapor out cooling of helium by 
pumping out vapor. 


The lighter isotope of He*® has three nucleons and obeys fermi statistics. 
The liquid phase is very well described by a fermi gas of the type discussed 
in Section 7.5. The interactions between atoms do not significantly change 
the non-interacting picture described earlier. By contrast, the heavier isotope 
of He* is a boson. Helium can be cooled down by a process of evaporation: 
liquid helium is placed in an isolated container, in equilibrium with the gas 
phase at a finite vapor density. As the helium gas is pumped out, part of the 
liquid evaporates to take its place. The evaporation process is accompanied by 
the release of latent heat, which cools the liquid. The boiling liquid is quite 
active and turbulent, just as a boiling pot of water. However, when the liquid is 
cooled down to below 2.2 K, it suddenly becomes quiescent and the turbulence 
disappears. The liquids on the two sides of this phase transition are usually 
referred to as Hel and Hell. 
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Fig. 7.14 Pushing 
superfluid helium 
through a (super-)leak 
can be achieved for 
P, > P,, and leads to 
cooling of the intake 
chamber. 


Fig. 7.15 Helium spurts 
out of the (resistively) 
heated chamber in the 
“fountain effect.” 
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Hell has unusual hydrodynamic properties. It flows through the finest cap- 
illaries without any resistance. Consider an experiment that pushes Hell from 
one container to another through a small tube packed with powder. For ordi- 
nary fluids a finite pressure difference between the containers, proportional to 
viscosity, is necessary to maintain the flow. Hell flows even in the limit of 
zero pressure difference and acts as if it has zero viscosity. For this reason 
it is referred to as a superfluid. The superflow is accompanied by heating of 
the container that loses HelI and cooling of the container that accepts it; the 
mechano-caloric effect. Conversely, Hell acts to remove temperature differ- 
ences by flowing from hot regions. This is demonstrated dramatically by the 
fountain effect, in which the superfluid spontaneously moves up a tube from a 
heated container. 


In some other circumstances Hell behaves as a viscous fluid. A classical 
method for measuring the viscosity of a liquid is via torsional oscillators: a 
collection of closely spaced disks connected to a shaft is immersed in the fluid 
and made to oscillate. The period of oscillations is proportional to the moment 
of inertia, which is modified by the quantity of fluid that is dragged by the 
oscillator. This experiment was performed on Hell by Andronikashvilli, who 
indeed found a finite viscous drag. Furthermore, the changes in the frequency 
of the oscillator with temperature indicate that the quantity of fluid that is 
dragged by the oscillator starts to decrease below the transition temperature. 
The measured normal density vanishes as T > 0, approximately as T*. 

In 1938, Fritz London suggested that a good starting hypothesis is that the 
transition to the superfluid state is related to the Bose-Einstein condensation. 
This hypothesis can account for a number of observations: 
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Fig. 7.16 A torsional 
oscillator can be used to 
measure the “normal 
fraction” in a superfluid. 


(1) The critical temperature of an ideal bose gas of volume v = 46.2 A? per particle is 
obtained from Eq. (7.54) as 


h2 


~ Qamyekp 


(vfsp) © 3.14K. (7.67) 


c 


The actual transition temperature of T, ~ 2.18 K is not far from this value. 

(2) The origin of the transition has to be related to quantum statistics as He*, which is 
atomically similar, but a fermion, does not have a similar transition. (Actually He* does 
become superfluid but at temperatures of only a few milli-Kelvin. This follows a pairing 
of He* atoms, which changes their statistics.) 

(3) A bose condensate can account for the observed thermo-mechanical properties of Hell. 
The expression for pressure in Eq. (7.55) is only a function of temperature, and not 
density. As such, variations in pressure are accompanied by changes in temperature. This 
is also the reason for the absence of boiling activity in Hell. Bubbles nucleate and grow 
in a boiling liquid at local hot spots. In an ordinary fluid, variations in temperature relax 
to equilibrium only through the slow process of heat diffusion. By contrast, if the local 
pressure is a function of temperature only, there will be increased pressure at a hot spot. 
The fluid flows in response to pressure gradients and removes them very rapidly (at the 
speed of sound in the medium). 

(4) Hydrodynamic behavior of Hell can be explained by Tisza’s two-fluid model, which 
postulates the coexistence of two components for T < T.: 


(a) A normal component of density p,, moving with velocity ¥,,, and having a finite 


n? 


entropy density s,,. 


(b) A superfluid component of density p,, which flows without viscosity and with no 
vorticity (V x “, =0), and has zero entropy density, s, = 0. 


In the super-leak experiments, it is the superfluid component that passes through, reducing 
the entropy and hence temperature. In the Andronikashvilli experiment, the normal 
component sticks to the torsional oscillator and gets dragged by it. This experiment thus 
gives the ratio of p,, to p,. 


There are, however, many important differences between superfluid helium 
and the ideal bose condensate: 
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(1) Interactions certainly play an important role in the liquid state. The Bose-Einstein con- 
densate has infinite compressibility, while Hell has a finite density, related to atomic 
volume, and is essentially incompressible. 

(2) It can be shown that, even at T = 0, the ideal bose condensate is not superfluid. This is 
because the low-energy spectrum, & (k) = h’k?/2m, admits too many excitations. Any 
external body moving through such a fluid can easily lose energy to it by exciting these 
modes, leading to a finite viscosity. 

(3) The detailed functional forms of the heat capacity and superfluid density are very different 
from their counterparts in the ideal bose condensate. The measured heat capacity diverges 
at the transition with a characteristic shape similar to A, and vanishes at low temperatures 
as T? (compared with T*/? for the ideal bose gas). The superfluid density obtained 


2/3 at the transition, while the 


in the Andronikashvilli experiment vanishes as (T, — T ) 
normal component vanishes as approximately T* as T > 0 (compared with T°”? for the 
condensate density in Eq. (7.52)). Understanding the nature of the singular behavior close 
to T. is beyond the scope of this discussion, and will be taken up in the accompanying 
volume. The behavior close to zero temperature, however, suggests a different spectrum 


of low-energy excitations. 


Based on the shape of the experimentally measured heat capacity, Landau 
suggested that the spectrum of low-energy excitations is actually similar to that 
of phonons. This is a consequence of the interactions between the particles. 
The low-energy excitations of a classical liquid are longitudinal sound waves. 
(In comparison, a solid admits three such excitations, two transverse and one 
longitudinal.) The correspondence principle suggests that quantized versions 
of such modes should also be present in a quantum liquid. As in the case of 
phonons, a linear spectrum of excitations leads to a heat capacity that vanishes 
as T°. The speed of sound waves can be computed from the coefficient of 
the T? dependence (see problems) as v ¥ 240ms~!. A further anomaly in heat 
capacity can be explained by assuming that the spectrum of excitations bends 
down and has a minimum in the vicinity of a wavenumber ky ~ 2A7'. The 
excitations in the vicinity of this minimum are referred to as rotons, and have 
an energy 


> h2 
oie (k) =A 2 Se (k = ko)’, (7.68) 
2m 


with A ~ 8.6K, and w ~ 0.16my,. The spectrum postulated by Landau was 
confirmed directly by neutron scattering measurements in the 1950s. 


Problems for chapter 7 


1. Identical particle pair: let Z,(m) denote the partition function for a single quantum 
particle of mass m in a volume V. 


(a) Calculate the partition function of two such particles, if they are bosons, and also if 
they are (spinless) fermions. 


Problems 203 


(b) Use the classical approximation Z,(m) = V/A} with A = h/,/27mk,T. Calculate the 
corrections to the energy E, and the heat capacity C, due to bose or fermi statistics. 


(c) At what temperature does the approximation used above break down? 
CK KK 40K 


. Generalized ideal gas: consider a gas of non-interacting identical (spinless) quantum 
particles with an energy spectrum ¢ = |p/fh|*, contained in a box of “volume” V in d 
dimensions. 


(a) Calculate the grand potential G, = —k,TInQ,, and the density n = N/V, at a 
chemical potential 4. Express your answers in terms of s, d, and f(z), where 


z=ef, and 


00 dxx”-! 


ii = 1 
I2) = Fay [ ar 


(Hint. Use integration by parts on the expression for In Q,,.) 


(b) Find the ratio PV/E, and compare it with the classical result obtained previously. 

(c) For fermions, calculate the dependence of E/N, and P, on the density n = N/V, at 
zero temperature. (Hint. f,,,(z) > (Inz)”/m! as z > oo.) 

(d) For bosons, find the dimension d,(s), below which there is no bose condensation. 


Is there condensation for s = 2 at d= 2? 
2k ok ok ok ok ok ok 


. Pauli paramagnetism: calculate the contribution of electron spin to its magnetic suscep- 


tibility as follows. Consider non-interacting electrons, each subject to a Hamiltonian 


where 4) = eh/2mc, and the eigenvalues of &- B are +B. 


(The orbital effect, p > p— eA, has been ignored.) 


(a) Calculate the grand potential G_ = —k,T1n Q_, at a chemical potential w. 

(b) Calculate the densities n, = N,/V, and n_ = N_/V, of electrons pointing parallel 
and anti-parallel to the field. 

(c) Obtain the expression for the magnetization M = p1)(N, — N_), and expand the result 
for small B. 

(d) Sketch the zero-field susceptibility y(7) = 0M/0B|,_,, and indicate its behavior at 
low and high temperatures. 


(e) Estimate the magnitude of y/N for a typical metal at room temperature. 


2k oR ook a RK 
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4. Freezing of He*: at low temperatures He* can be converted from liquid to solid by 


application of pressure. A peculiar feature of its phase boundary is that (dP/d7) meting 18 
negative at temperatures below 0.3K [(dP/d7),, * —30atm K7! at T+ 0.1K]. We will 
use a simple model of liquid and solid phases of He* to account for this feature. 


(a) In the solid phase, the He* atoms form a crystal lattice. Each atom has nuclear spin 
of 1/2. Ignoring the interaction between spins, what is the entropy per particle s,, due 
to the spin degrees of freedom? 

(b) Liquid He? is modeled as an ideal fermi gas, with a volume of 46 A? per atom. What 
is its fermi temperature 7,,, in degrees Kelvin? 

(c) How does the heat capacity of liquid He* behave at low temperatures? Write down 
an expression for Cy in terms of N,7,k,,7;, up to a numerical constant, that is 
valid for T < T;. 

(d) Using the result in (c), calculate the entropy per particle s,, in the liquid at low 
temperatures. For T < T,, which phase (solid or liquid) has the higher entropy? 

(e) By equating chemical potentials, or by any other technique, prove the Clausius— 
Clapeyron equation (dP/d7) meting = (Se — 5,)/(ve — V,), Where v, and v, are the 
volumes per particle in the liquid and solid phases, respectively. 

(f) It is found experimentally that v, — v, = 3A? per atom. Using this information, plus 


the results obtained in previous parts, estimate (dP/dT) atT <T,. 


melting 
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. Non-interacting fermions: consider a grand canonical ensemble of non-interacting 


fermions with chemical potential w. The one-particle states are labeled by a wave vector 


k, and have energies € (k). 


(a) What is the joint probability P({n;z}) of finding a set of occupation numbers {n;} of 
the one-particle states? 

(b) Express your answer to part (a) in terms of the average occupation numbers {(ng)_ h 

(c) A random variable has a set of € discrete outcomes with probabilities p,, where 
n=1,2,---,€. What is the entropy of this probability distribution? What is the 
maximum possible entropy? 

(d) Calculate the entropy of the probability distribution for fermion occupation numbers 
in part (b), and comment on its zero-temperature limit. 

(e) Calculate the variance of the total number of particles (N?)., and comment on its 
zero-temperature behavior. 

(f) The number fluctuations of a gas are related to its compressibility «;, and number 
density n = N/V, by 


(N?)_ = NnkgTkr. 


Give a numerical estimate of the compressibility of the fermi gas in a metal at T =0 
in units of A?eV7. 


2K ok ok ok 2k GK 
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6. Stoner ferromagnetism: the conduction electrons in a metal can be treated as a gas of 
fermions of spin 1/2 (with up/down degeneracy), and density n = N/V. The Coulomb 
repulsion favors wave functions that are anti-symmetric in position coordinates, thus 
keeping the electrons apart. Because of the full (position and spin) anti-symmetry of 
fermionic wave functions, this interaction may be approximated by an effective spin— 
spin coupling that favors states with parallel spins. In this simple approximation, the net 


effect is described by an interaction energy 


where NV, and N_ = N—N, are the numbers of electrons with up and down spins, and V 
is the volume. (The parameter a is related to the scattering length a by a = 47rh?a/m.) 


(a) The ground state has two fermi seas filled by the spin-up and spin-down electrons. 
Express the corresponding fermi wavevectors k,,, in terms of the densities n, = N/V. 
(b) Calculate the kinetic energy density of the ground state as a function of the densities 


n,, and fundamental constants. 


(c) Assuming small deviations n, =n/2+6 from the symmetric state, expand the kinetic 
energy to fourth order in 6. 

(d) Express the spin-spin interaction density U/V in terms of n and 6. Find the critical 
value of @., such that for a > a, the electron gas can lower its total energy by 
spontaneously developing a magnetization. (This is known as the Stoner instability.) 

(e) Explain qualitatively, and sketch the behavior of, the spontaneous magnetization as 


a function of a. 
2k ok ok ok ok ok ok 


7. Boson magnetism: consider a gas of non-interacting spin | bosons, each subject to a 
Hamiltonian 
i) 
H(p.s,=2 B 
iP, me) pte — Kos, 5} 
2m 


where 1) = eh/mc, and s, takes three possible values of (—1, 0, +1). (The orbital effect, 
p > p—eA, has been ignored.) 


(a) In a grand canonical ensemble of chemical potential 4, what are the average occu- 
pation numbers { (rn, (k)), (no(k)), mw) 


k= p/h? 
(b) Calculate the average total numbers {N,, Nj, N_} of bosons with the three possible 


of one-particle states of wavenumber 


values of s, in terms of the functions f*(z). 

(c) Write down the expression for the magnetization M(T, “) = fo(N, — N_), and 
by expanding the result for small B find the zero-field susceptibility y(T, “) = 
AM /0B| 5-0. 

To find the behavior of y(7, n), where n = N/V is the total density, proceed as 
follows: 

(d) For B = 0, find the high-temperature expansion for z(8, n) = e*", correct to second 
order in n. Hence obtain the first correction from quantum statistics to y(T, n) at 


high temperatures. 
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(e) Find the temperature T,(n, B = 0) of Bose-Einstein condensation. What happens to 
X(T, n) on approaching T.(n) from the high-temperature side? 

(f) What is the chemical potential w for T < T,.(n), at a small but finite value of B? 
Which one-particle state has a macroscopic occupation number? 


(g) Using the result in (f), find the spontaneous magnetization 


M(T,n) = lim M(T, n, B). 
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8. Dirac fermions are non-interacting particles of spin 1/2. The one-particle states come in 


pairs of positive and negative energies, 


E(k) =+VJm?c* + h?k?c?, 


independent of spin. 


(a) For any fermionic system of chemical potential 1, show that the probability of finding 
an occupied state of energy 4+ is the same as that of finding an unoccupied state 
of energy  — 6. (6 is any constant energy.) 

(b) At zero temperature all negative energy Dirac states are occupied and all positive 
energy ones are empty, that is, w(T = 0) = 0. Using the result in (a) find the chemical 
potential at finite temperature T. 


(c) Show that the mean excitation energy of this system at finite temperature satisfies 
Bk E(k) 
2m) exp (Bé..(k)) +1 


E(T) — E(0) =v | 


(d) Evaluate the integral in part (c) for massless Dirac particles (i.e., for m = 0). 

(e) Calculate the heat capacity, Cy, of such massless Dirac particles. 

(f) Describe the qualitative dependence of the heat capacity at low temperature if the 
particles are massive. 
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9. Numerical estimates: the following table provides typical values for the fermi energy and 
fermi temperature for (i) electrons in a typical metal; (ii) nucleons in a heavy nucleus; 
and (iii) He® atoms in liquid He* (atomic volume = 46.2 A? per atom). 


(a) Estimate the ratio of the electron and phonon heat capacities at room temperature 
for a typical metal. 

(b) Compare the thermal wavelength of a neutron at room temperature to the minimum 
wavelength of a phonon in a typical crystal. 

(c) Estimate the degeneracy discriminant, nA, for hydrogen, helium, and oxygen gases 
at room temperature and pressure. At what temperatures do quantum mechanical 
effects become important for these gases? 


Problems 


n(1/m*) m (kg) Ep (eV) Ty (K) 
Electron 107° 9x 107-7! 4.4 5x 10 
Nucleons 10“ 1.6 x 10777 1.0 x 108 1.1 x 10!” 
Liquid He? 2.6 x 1078 4.6 x 10-7’ 10-3 10! 


10. 


11. 


(d) Experiments on He’ indicate that at temperatures below 1K, the heat capacity is 
given by Cy = 20.47?J kg~'K~!. Find the low-energy excitation spectrum, E(k), 
of He’. 


(Hint. There is only one non-degenerate branch of such excitations.) 
HOCK AK a 40k 


Solar interior: according to astrophysical data, the plasma at the center of the Sun has 
the following properties: 

Temperature: T=1.6x10’K 

Hydrogen density: py, =6 x 10*kg m™ 

Helium density: Pre = 1x 10°kg m-. 


(a) Obtain the thermal wavelengths for electrons, protons, and a-particles (nuclei of He). 

(b) Assuming that the gas is ideal, determine whether the electron, proton, or a-particle 
gases are degenerate in the quantum mechanical sense. 

(c) Estimate the total gas pressure due to these gas particles near the center of the Sun. 

(d) Estimate the total radiation pressure close to the center of the Sun. Is it matter, or 
radiation pressure, that prevents the gravitational collapse of the Sun? 
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Bose condensation in d dimensions: consider a gas of non-interacting (spinless) bosons 
with an energy spectrum € = p’/2m, contained in a box of “volume” V = L4 in d 
dimensions. 


(a) Calculate the grand potential G = —k,T In Q, and the density n = N/V, at a chemical 


potential 4. Express your answers in terms of d and f+ (z), where z = e?, and 


xml 


1 fos} 
T(m) I zter—] 


Fm (2) = dx. 
(Hint. Use integration by parts on the expression for In Q.) 

(b) Calculate the ratio PV/E, and compare it with the classical value. 

(c) Find the critical temperature, T. (), for Bose-Einstein condensation. 

(d) Calculate the heat capacity C (T) for T < T, (n). 

(e) Sketch the heat capacity at all temperatures. 

(f) Find the ratio, C,y4,/C (I — 00), of the maximum heat capacity to its classical limit, 
and evaluate it in d = 3. 
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12. 


13. 


(g) How does the above calculated ratio behave as d > 2? In what dimensions are your 
results valid? Explain. 
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Exciton dissociation in a semiconductor: shining an intense laser beam on a semicon- 
ductor can create a metastable collection of electrons (charge —e, and effective mass 
m,) and holes (charge +e, and effective mass m,) in the bulk. The oppositely charged 
particles may pair up (as in a hydrogen atom) to form a gas of excitons, or they may 
dissociate into a plasma. We shall examine a much simplified model of this process. 


(a) Calculate the free energy of a gas composed of N, electrons and N, holes, at temperature 
T, treating them as classical non-interacting particles of masses m, and my. 


(b) By pairing into an excition, the electron hole pair lowers its energy by e. (The binding 
energy of a hydrogen-like exciton is ¢ © me*/(2h7e7), where € is the dielectric 


1 


constant, and m~' = m;'!+m,,'.) Calculate the free energy of a gas of N, excitons, 


treating them as classical non-interacting particles of mass m =m, + m,. 
(c) Calculate the chemical potentials y., 4, and y, of the electron, hole, and exciton 
states, respectively. 


(d) Express the equilibrium condition between excitons and electrons/holes in terms of 
their chemical potentials. 

(e) At a high temperature T, find the density n, of excitons, as a function of the total 
density of excitations n ~n,+n,. 
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Freezing of He*: at low temperatures He* can be converted from liquid to solid by 
application of pressure. An interesting feature of the phase boundary is that the melting 


? at its 


pressure is reduced slightly from its T= OK value, by approximately 20N m7 
minimum at T = 0.8K. We will use a simple model of liquid and solid phases of Het* 


to account for this feature. 


(a) The important excitations in liquid He* at T < 1 K are phonons of velocity c. Calculate 
the contribution of these modes to the heat capacity per particle, C/./N, of the liquid. 

(b) Calculate the low-temperature heat capacity per particle, C},/N, of solid He* in terms 
of longitudinal and transverse sound velocities c; and cr. 

(c) Using the above results calculate the entropy difference (s,—s,), assuming a single 
sound velocity c ¥ c,; © c;, and approximately equal volumes per particle v, © v, © v. 
Which phase (solid or liquid) has the higher entropy? 


(d) Assuming a small (temperature-independent) volume difference dv = v, — v,, calcu- 
late the form of the melting curve. To explain the anomaly described at the beginning, 
which phase (solid or liquid) must have the higher density? 
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14. 


15. 


16. 


Problems 


Neutron star core: Professor Rajagopal’s group at MIT has proposed that a new phase 
of QCD matter may exist in the core of neutron stars. This phase can be viewed as a 


condensate of quarks in which the low-energy excitations are approximately 


> 2 
Ek), = pt) 


The excitations are fermionic, with a degeneracy of g = 2 from spin. 


(a) At zero temperature all negative energy states are occupied and all positive energy 
ones are empty, that is, w4(7T = 0) = 0. By relating occupation numbers of states 
of energies 4~7+6 and uw —64, or otherwise, find the chemical potential at finite 
temperatures T. 

(b) Assuming a constant density of states near k = k,, that is, setting d°k ~ 4ak?.dq 
with g = al —k,, show that the mean excitation energy of this system at finite 


temperature is 


2 


AS kp * €4() 
E(T)— EO) ~ 2@v— | een + 


BE,(q)) +1 


(c) Give a closed form answer for the excitation energy by evaluating the above integral. 


d) Calculate the heat capacity, Cy, of this system, and comment on its behavior at low 
pacity, Cy y 
temperature. 
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Non-interacting bosons: consider a grand canonical ensemble of non-interacting bosons 
with chemical potential 41. The one-particle states are labeled by a wave vector q, and 
have energies €(q). 


(a) What is the joint probability P({nj}) of finding a set of occupation numbers {nj} of 
the one-particle states, in terms of the fugacities z; = exp [B(u -€ (9))]? 

(b) For a particular g, calculate the characteristic function (exp [ikn;]). 

(c) Using the result of part (b), or otherwise, give expressions for the mean and variance 
of nz occupation number (nj). 

(d) Express the variance in part (c) in terms of the mean occupation number (n;). 

(e) Express your answer to part (a) in terms of the occupation numbers {(n;)}. 

(f) Calculate the entropy of the probability distribution for bosons, in terms of {(n;)}. 
and comment on its zero-temperature limit. 
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Relativistic bose gas in d dimensions: consider a gas of non-interacting (spinless) bosons 
, contained in a box of “volume” V = L? in d dimensions. 


with energy €=c |p 


(a) Calculate the grand potential G = —k,T In Q, and the density n = N/V, at a chemical 


potential 4. Express your answers in terms of d and f+ (z), where z = e?", and 


xl 
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Ideal quantum gases 


17. 


(Hint. Use integration by parts on the expression for In Q.) 


(b) Calculate the gas pressure P, its energy E, and compare the ratio E/(PV) to the 
classical value. 

(c) Find the critical temperature, T, (n), for Bose-Einstein condensation, indicating the 
dimensions where there is a transition. 

(d) What is the temperature dependence of the heat capacity C (T) for T < T, (n)? 

(e) Evaluate the dimensionless heat capacity C(T)/(Nk,) at the critical temperature 
T =T., and compare its value to the classical (high-temperature) limit. 
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Graphene is a single sheet of carbon atoms bonded into a two-dimensional hexagonal 
lattice. It can be obtained by exfoliation (repeated peeling) of graphite. The band struc- 
ture of graphene is such that the single-particle excitations behave as relativistic Dirac 


fermions, with a spectrum that at low energies can be approximated by 


Ex(R) = thu kl. 


There is spin degeneracy of g = 2, and v ¥ 10°m s~!. Experiments on unusual transport 
properties of graphene were reported in Nature 438, 197 (2005). In this problem, you 
shall calculate the heat capacity of this material. 


(a) If at zero temperature all negative energy states are occupied and all positive energy 
ones are empty, find the chemical potential (T ). 
(b) Show that the mean excitation energy of this system at finite temperature satisfies 
Pk E(k) 
5 = ; 
27)” exp (Bé,(k)) +1 


E(T) —E(0) =44 | 


(c) Give a closed form answer for the excitation energy by evaluating the above integral. 

(d) Calculate the heat capacity, Cy, of such massless Dirac particles. 

(e) Explain qualitatively the contribution of phonons (lattice vibrations) to the heat 
capacity of graphene. The typical sound velocity in graphite is of the order of 
2x 10*m s7!. Is the low temperature heat capacity of graphene controlled by phonon 
or electron contributions? 
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Solutions to selected problems from 
chapter 1 


1. Surface tension: thermodynamic properties of the interface between two phases are 
described by a state function called the surface tension S. It is defined in terms of the 
work required to increase the surface area by an amount dA through dW = SdA. 


(a) By considering the work done against surface tension in an infinitesimal change in 
radius, show that the pressure inside a spherical drop of water of radius R is larger 
than outside pressure by 2S/R. What is the air pressure inside a soap bubble of 
radius R? 

The work done by a water droplet on the outside world, needed to increase the 
radius from R to R+ AR, is 


AW = (P—P,)-47R?- AR, 


where P is the pressure inside the drop and P, is the atmospheric pressure. In 


equilibrium, this should be equal to the increase in the surface energy SAA = 


S-8a7R-AR, where S is the surface tension, and 
AWooral = 0, = AWoressure = —AWourtace ? 
resulting in 


2 
(P—P,)-47R?-AR=8-87R-AR, = (P-P,)= as 


In a soap bubble, there are two air—soap surfaces with almost equal radii of 
curvatures, and 


2 


Prim me a interior ~~ Prim = R > 


2) 


leading to 


48 
P,=—. 


P; 7 
R 


interior ~~ 
Hence, the air pressure inside the bubble is larger than atmospheric pressure by 
4S/R. 

(b) A water droplet condenses on a solid surface. There are three surface tensions 

S,,, and & 


involved, S where a, s, and w refer to air, solid, and water, 


aw? sa? 
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respectively. Calculate the angle of contact, and find the condition for the appearance 
of a water film (complete wetting). 

When steam condenses on a solid surface, water either forms a droplet, or spreads 
on the surface. There are two ways to consider this problem: 


Method 1. Energy associated with the interfaces. 
In equilibrium, the total energy associated with the three interfaces should be at 


a minimum, and therefore 
dE — Saw dA gy tT Sas dA,, a Sus dA,,. = 0. 
Since the total surface area of the solid is constant, 


dA,,+dA,,, = 0. 


as 


From geometrical considerations (see proof below), we obtain 
dA,,, cos 6 = dA,,,. 


From these equations, we obtain 


Sas 7 Sus 


dE = (S,,, cos 8—S,,+S,;)dAy;=0, = > cosd= 5 


as 
aw 


Proof of dA,,,cos 6 = dA,,,,: consider a droplet that is part of a sphere of radius R, 


which is cut by the substrate at an angle 0. The areas of the involved surfaces are 
Ay, = 7(R sin 6)’, and Agu = 27R*(1 —cos 8). 


Let us consider a small change in shape, accompanied by changes in R and 0. These 


variations should preserve the volume of water, that is, constrained by 


3 
V= ™ (cos @—3c0s0+2). 


Introducing x = cos 0, we can rewrite the above results as 
( Ays = TR? (1-2), 


Agw = 27R? (1—x), 


3 
™ (x'- 3x42). 


rf V 
The variations of these quantities are then obtained from 
dR 5 
dA,,, = 27R | —(1—x°)— Rx | dx, 
dx 
dR 
dA,,, = 27R | 2—(1—x)—R| dx, 
dx 


dR 
dV = aR’ | eo? —3042)+ R29] dx =0. 
xX 
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From the last equation, we conclude 


1dR | Pax _ x+1 
Rdx  »8—3x4+2° (x—1)(x+2)' 


Substituting for dR/dx gives 


dx ,x-dx 
and dA,,, =27R ; 
+2 


x+2’ x 


dA,,, = 27R? 


resulting in the required result of 
dA,,, =x-dA,,, =dA,,, cos 0. 


Method 2. Balancing forces on the contact line. 

Another way to interpret the result is to consider the force balance of the equi- 
librium surface tension on the contact line. There are four forces acting on the line: 
(1) the surface tension at the water—gas interface, (2) the surface tension at the 
solid—water interface, (3) the surface tension at the gas—solid interface, and (4) the 
force downward by solid—contact line interaction. The last force ensures that the 
contact line stays on the solid surface, and is downward since the contact line is 
allowed to move only horizontally without friction. These forces should cancel along 
both the y and x directions. The latter gives the condition for the contact angle 


known as Young’s equation, 


Sas am S ws 


Ss =Syy:COSO+S5,,, = > cosd= 3 


aw 
The critical condition for the complete wetting occurs when 6 = 0, or cos 6 = 1, that 


is, for 


Sas — ws 
s — - | 


& 


cos 0¢ = 


aw 


Complete wetting of the substrate thus occurs whenever 


Saw = Sas ~~ Sys. 


(c) Inthe realm of “large” bodies gravity is the dominant force, while at “small” distances 
surface tension effects are all important. At room temperature, the surface tension 
of water is &, * 7x 10-?N m7’. Estimate the typical length scale that separates 

“large” and “small” behaviors. Give a couple of examples for where this length scale 

is important. 

Typical length scales at which the surface tension effects become significant are 
given by the condition that the forces exerted by surface tension and relevant pressures 
become comparable, or by the condition that the surface energy is comparable to the 


other energy changes of interest. 


Example 1. Size of water drops not much deformed on a non-wetting surface. This 


is given by equalizing the surface energy and the gravitational energy, 


4 
S-47R? = mgR = pVgR = >Re, 
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leading to 


3S 3x 7x 10-7N/m =4 
R®& x 15x 10° m= 1.5mm. 
pg 103 kg/m? x 10 m/s? 


Example 2. Swelling of spherical gels in a saturated vapor: osmotic pressure of the 


gel (about 1 atm) = surface tension of water, gives 


_N, 28 
T gel ~ go R: 


where N is the number of counter-ions within the gel. Thus, 


an 2x7x10-7N/m ~ 10-Sm. 
105 N/m? 
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2. Surfactants: surfactant molecules such as those in soap or shampoo prefer to spread on 
the air—water surface rather than dissolve in water. To see this, float a hair on the surface 
of water and gently touch the water in its vicinity with a piece of soap. (This is also why 
a piece of soap can power a toy paper boat.) 


(a) The air—water surface tension S, (assumed to be temperature-independent) is reduced 
roughly by Nk,7/A, where N is the number of surfactant particles, and A is the area. 
Explain this result qualitatively. 

Typical surfactant molecules have a hydrophilic (water-soluble) head and a 
hydrophobic (oil-soluble) tail, and prefer to go to the interface between water and 


air, or water and oil. Some examples are, 


CH, — (CH,),, — SO; -Na*, 


CH, — (CH,),;, —N*(CH;);-Cl, 


CH, — (CH,),, — O— (CH, — CH, — O),, —H. 


The surfactant molecules spread over the surface of water and behave as a two- 
dimensional gas. The gas has a pressure proportional to the density and the abso- 
lute temperature, which comes from the two-dimensional degrees of freedom of the 
molecules. Thus the surfactants lower the free energy of the surface when the surface 


area is increased. 


ms N 
AF surfactant = Ps es (S—S,)-AA, ==> 5=5,- Get 


(Note that surface tension is defined with a sign opposite to that of hydrostatic 
pressure.) 

(b) Place a drop of water on a clean surface. Observe what happens to the air—water— 
surface contact angle as you gently touch the droplet surface with a small piece of 
soap, and explain the observation. 
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As shown in the previous problem, the contact angle satisfies 


Sas — S ws 


Touching the surface of the droplet with a small piece of soap reduces & 


cos 6 = 
aw 
aws hence 


cos @ increases, or equivalently, the angle @ decreases. 


(c) More careful observations show that at higher surfactant densities 


NkgT  2a(N\? a 2 
= , an —: 
7 (A-NbP A\A as 


0s 
0A 


A—Nb 
A Nk g 


> 


where a and b are constants. Obtain the expression for S(A, T) and explain qualita- 
tively the origin of the corrections described by a and b. 
When the surfactant molecules are dense their interaction becomes important, 


resulting in 


dS| _  NksT — 2a (N\’ 
dA|, (A—Nb)? A\A)? 
and 
éT| | A-—Nb 
dS|, Nkg © 


Integrating the first equation gives 


2 
84,0 = f(r) — et +a(*) 


A—Nb 
where f(T) is a function of only T, while integrating the second equation yields 
Nk,T 
A— Nb’ 
with g(A) a function of only A. By comparing these two equations we get 


NkgT N\? 
A, T) = 8,- a 
ee a wa t(5) 


5(A, T) = (A) — 


where S, represents the surface tension in the absence of surfactants and is inde- 
pendent of A and T. The equation resembles the van der Waals equation of state for 
gas—liquid systems. The factor Nb in the second term represents the excluded volume 
effect due to the finite size of the surfactant molecules. The last term represents the 
binary interaction between two surfactant molecules. If surfactant molecules attract 
each other, the coefficient a is positive and the surface tension increases. 


(d) Find an expression for C; — C, in terms of o r= on 9 “ p> and a ie 
Taking A and T as independent variables, we obtain 
dQ=dE-—S-dA, = dQ= _ dA+ = dT—S-dA, 
OA |r oT |, 
and 
o-(Z) -s)aa+ 5] ar 
0A |, rn 
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From the above result, the heat capacities are obtained as 


f 6Q OE 
C= =| == 
6T|, oT |, 
6 OE 0A OE 
Cs = Q = 3 
{ 6T |. 0A |, OT |, OT |g 
resulting in 
OE 0A 
Cs—Cy= 3 : 
0A|> OT |; 
Using the chain rule 
6T| 08| Al aoe 
dS|, dA|, at |, ; 


we obtain 


oo (x s) ( Zi 
8 a= i: or j : 
dA |r ce aa 
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3. Temperature scales: prove the equivalence of the ideal gas temperature scale ©, and the 


thermodynamic scale T, by performing a Carnot cycle on an ideal gas. The ideal gas 
satisfies PV = Nk,Q, and its internal energy E is a function of © only. However, you 
may not assume that E x ®. You may wish to proceed as follows: 


(a) Calculate the heat exchanges Q,, and Q;, as a function of ©,, O,, and the volume 
expansion factors. 


The ideal gas temperature is defined through the equation of state 


_ PV 


6=—_., 
Nkp 


The thermodynamic temperature is defined for a reversible Carnot cycle by 


Tot —_ Dror 


Toot Qeoia 


For an ideal gas, the internal energy is a function only of 0, that is, E = E(0), and 


dE 
dQ =dE-dW =~, -d0+ Pav. 


Consider the Carnot cycle indicated in the figure. For the segment 1 to 2, which 


undergoes an isothermal expansion, we have 


NKkp Prot 


d0=0,=> dj = PAV, and P= —— 
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adiabatics (AQ = 0) 
\ 


pressure P 


\ 
\ isothermals 


Gold 


Se ; 
\ Qoolad 3 an 


a 


volume V 


Hence, the heat input of the cycle is related to the expansion factor by 


V2 dv V. 
Dot =| Nk Ono ye Nk py. In (2) : 
1 


1 


A similar calculation along the low-temperature isotherm yields 


V3 dv V. 
Qeota = / Nk 9 coi yo Nk 8 o14 In (4) , 
4 4 


and thus 


Qhot Oyo In (V>/V)) 


Qcota 7 Boia In (V3/V4) ” 


(b) Calculate the volume expansion factor in an adiabatic process as a function of ©. 


Next, we calculate the volume expansion/compression ratios in the adiabatic pro- 


cesses. Along an adiabatic segment 


40 = ee ee ae Nk,6 ayass 1 dE 
do V ; V—Nk,0 dé 


Integrating the above between the two temperatures, we obtain 
V. 1 Mo 1 dE 
( In( = )= | -dé, and 
V, NKeg J 6.3 8 dé 


f(a fl 
( vy, ~ Nkp hg PaO 


While we cannot explicitly evaluate the integral (since E(@) is arbitrary), we can 


nonetheless conclude that 
Vi _ Ve 
Vi, V3 
(c) Show that O,,/O, = @,/Oc. 
Combining the results of parts (a) and (b), we observe that 


Dror oa, Phot 


Qeota Peoid 


217 


218 Solutions to selected problems from chapter 1 


Since the thermodynamic temperature scale is defined by 


Dror -_ Trot 


we conclude that 6 and T are proportional. If we further define @(triple pointy.) = 
T(triple pointy,9) = 273.16, 6 and T become identical. 
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4. Equations of state: the equation of state constrains the form of internal energy as in the 
following examples. 


(a) Starting from dE = TdS — PdV, show that the equation of state PV = Nk,T in fact 
implies that E can only depend on T. 
Since there is only one form of work, we can choose any two parameters as 
independent variables. For example, selecting T and V, such that E = E(T, V), and 
S= S(T, V), we obtain 


dE =TdS—PdV =T us dT+T ies dV — PdV. 
7 ar |, V |p , 
resulting in 
OE 0s 
—| =T —| -P. 
OV \y OV \> 
Using Maxwell’s relation' 
OS} OP 
V\, aT ly’ 
we obtain 
OE oP 
—| =T —| -P. 
WV |, oT |y 
Since T vl, = The = P, for an ideal gas, & |, = 0. Thus E depends only on T, 


that is, E = E(T). 
(b) What is the most general equation of state consistent with an internal energy that 
depends only on temperature? 
If E=E(1), 


OE 


Se ce) T 
av i 


T 


The solution for this equation is P = f(V)T, where f(V) is any function of only V. 
(c) Show that for a van der Waals gas Cy, is a function of temperature alone. 


The van der Waals equation of state is given by 


[P- a (7) | -(V—Nb) = NkgT, 


' dLb=Xdx4+Ydy+---,=5 *| = 


Solutions to selected problems from chapter 1 219 


or 


NkpT N\? 
P=. eal), 
(V — Nb) V 


From these equations, we conclude that 


_ OE 
~ OT 


aCy 
av 


Cy 


_ PE df, oP 
, OVOT aT | OT 


#&P 
Pl=T — 
Vv 


; 
Vv 
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5. The Clausius—Clapeyron equation describes the variation of boiling point with pressure. 
It is usually derived from the condition that the chemical potentials of the gas and liquid 
phases are the same at coexistence. 


From the equations 
Hriguia (P T)= Meas (P, T), 
and 
Hiiquia(P + dP, T+ dT) = bgas(P +P, T+4T), 


we conclude that along the coexistence line 


He) S| 
dP aT \p or lp 

; 4 
aT coX | = os 

oP \T oP T 


The variations of the Gibbs free energy, G= Nu(P,T), from the extensivity condition 


are given by 


dG dG 
V=—|, S=-—|. 
OP |, OT |p 
In terms of intensive quantities 
Vo oop S Om 
v= SS SO F sS= SS 7 
N OP |, N OT |p 


where s and v are molar entropy and volume, respectively. Thus, the coexistence line 


satisfies the condition 


dP — S,-S;  S,— 8} 


dT \oox  Ve-Vi Ug) 


For an alternative derivation, consider a Carnot engine using one mole of water. At the 
source (P, T) the latent heat L is supplied converting water to steam. There is a volume 
increase V associated with this process. The pressure is adiabatically decreased to P—dP. 
At the sink (P — dP, T —dT) steam is condensed back to water. 
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(a) Show that the work output of the engine is W = VdP + O(dP?). Hence obtain the 
Clausius—Clapeyron equation 


dP 
dT 


: 
= (1) 


If we approximate the adiabatic processes as taking place at constant volume V 
(vertical lines in the P—V diagram), we find 


boiling 


W = Pav = PV—(P—dP)V= VaP. 


> 


pressure 


0 > 


volume 


Here, we have neglected the volume of the liquid state, which is much smaller than 
that of the gas state. As the error is of the order of 


ov 


—| dP-dP=O(dP’), 
dP |, 


we have 


W = VdP+O(dP’). 
The efficiency of any Carnot cycle is given by 


Ww 7 


qQ= 2 = 
Qn, Ty 


and in the present case, 
O,=L, W=VdP, Ty=T, To =T—dT. 


Substituting these values in the universal formula for efficiency, we obtain the 
Clausius—Clapeyron equation 


VdP dT dP 
— = or 


.. > 


is 
dT]... TV 


(b) 


= 
io) 
YS 


(d) 
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What is wrong with the following argument: “The heat Q,, supplied at the source to 
convert one mole of water to steam is L(T). At the sink L(T —dT) is supplied to 
condense one mole of steam to water. The difference dTdL/dT must equal the work 
W =VdP, equal to LdT/T from Eq. (1). Hence dL/dT = L/T, implying that L is 
proportional to T!” 

The statement “At the sink L(T —dT ) is supplied to condense one mole of water" 
is incorrect. In the P—V diagram shown, the state at “1” corresponds to pure water, 
“2” corresponds to pure vapor, but the states “3” and “4” have two phases coexisting. 
In going from the state 3 to 4 less than one mole of steam is converted to water. Part 
of the steam has already been converted into water during the adiabatic expansion 
2 — 3, and the remaining portion is converted in the adiabatic compression 4 —> 1. 
Thus the actual latent heat should be less than the contribution by one mole of water. 
Assume that L is approximately temperature-independent, and that the volume change 
is dominated by the volume of steam treated as an ideal gas, that is, V = Nk,T/P. 
Integrate Eq. (1) to obtain P(T). 


For an ideal gas 


_ NkgT dP | LP dP E 


= » OF = 7 
P dT |... NkgT? P  NksT? 


Vv dT. 


’ 


Integrating this equation, the boiling temperature is obtained as a function of the 


pressure P, as 


L 
P=C-exp 7 ae ik 
B* Boiling 


A hurricane works somewhat like the engine described above. Water evaporates at 
the warm surface of the ocean, steam rises up in the atmosphere, and condenses 
to water at the higher and cooler altitudes. The Coriolis force converts the upward 
suction of the air to spiral motion. (Using ice and boiling water, you can create a 
little storm in a tea cup.) Typical values of warm ocean surface and high altitude 
temperatures are 80° F and —120° F, respectively. The warm water surface layer must 
be at least 200 feet thick to provide sufficient water vapor, as the hurricane needs to 
condense about 90 million tons of water vapor per hour to maintain itself. Estimate 
the maximum possible efficiency, and power output, of such a hurricane. (The latent 
heat of vaporization of water is about 2.3 x 10°J kg™'.) 

For Tc = —120° F = 189° K, and T,, = 80° F = 300° K, the limiting efficiency, as 


that of a Carnot engine, is 


Ty — Tc 
Ty 


= 0.37. 


Tmax = 


The output power, equal to (input power) x (efficiency), is 


90 x 10° tons lhr 1000kg 2.3 x 10°J 
hr 3600sec ton kg 


power output = 


2k ok 2k KK KK 


x 0.37 =2 x 10 watts. 
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6. Glass: liquid quartz, if cooled slowly, crystallizes at a temperature T,,, and releases latent 


heat L. Under more rapid cooling conditions, the liquid is supercooled and becomes 


glassy. 


(a) As both phases of quartz are almost incompressible, there is no work input, and 
changes in internal energy satisfy dE = TdS + wdN. Use the extensivity condition to 
obtain the expression for wz in terms of E, T, S, and N. 


Since in the present context we are considering only chemical work, we can regard 
entropy as a function of two independent variables, for example, E and N, which 
appear naturally from dS = dE/T — wdN/T. Since entropy is an extensive variable, 
AS = S(AE, AN). Differentiating this with respect to X and evaluating the resulting 


expression at k= 1 gives 


as | as | E N 
S(E, N) = E+—| N= al 
OE |y ON |r T T 
leading to 
_ E-TS 
= x 
(b) The heat capacity of crystalline quartz is approximately Cy = aT?, while that of glassy 


quartz is roughly Cg = BT, where a and B are constants. 
Assuming that the third law of thermodynamics applies to both crystalline and glass 
phases, calculate the entropies of the two phases at temperatures T < T,,. 


Finite-temperature entropies can be obtained by integrating dQ/T, starting from 


S(T =0) = 0. Using the heat capacities to obtain the heat inputs, we find 


3 T AS crystal Na T? 
Crystal =aT°= N dT >= Serystal = Bees 
T Sotass 
_ _ glass _ 
( Cytass = BT = N dT’ => Satass = BNT. 
(c) At zero temperature the local bonding structure is similar in glass and crystalline 


quartz, so that they have approximately the same internal energy Ey. Calculate the 


internal energies of both phases at temperatures T < T, 


Since dE = TdS+ pdN, for dN = 0, we have 


dE =TdS=aNT? dT (crystal), 


dE =TdS=BNTdT (glass). 


Integrating these expressions, starting with the same internal energy E, at T =0, 


yields 


N_, 
( E=E,+ a4 (crystal), 


N 
E=E,+ at (glass). 


oO 


(d) 


(e 


wm 


(f) 
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Use the condition of thermal equilibrium between two phases to compute the equilib- 
rium melting temperature 7, in terms of a and B. 


From the condition of chemical equilibrium between the two phases, Werystal = glass? 


ae 1 aT’ pT? 
~—-)-aT*=(1-——)- pT’, > — =—, 
(; i) 7 ( 3) Z 12 2 


we obtain 


resulting in a transition temperature 


[6B 
Lett = aes 
a 


Compute the latent heat L in terms of a and B. 
From the assumptions of the previous parts, we obtain the latent heats for the glass 
to crystal transition as 


aT? 
L= Trrett (8 sieas = | = NT ret (6 Trett = we | 


2 ards 2 2 
= NT et B 7° i o = NTwret (B ~ 2B) = —NBT ret <0. 


Is the result in the previous part correct? If not, which of the steps leading to it is most 
likely to be incorrect? 

The above result implies that the entropy of the crystal phase is larger than that of 
the glass phase. This is clearly unphysical, and one of the assumptions must be wrong. 
The questionable step is the assumption that the glass phase is subject to the third 
law of thermodynamics, and has zero entropy at T = 0. In fact, glass is a non-ergodic 
state of matter that does not have a unique ground state, and violates the third law. 
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1. Characteristic functions: calculate the characteristic function, the mean, and the variance 
of the following probability density functions: 


(a) Uniform p(x) = x for -a<x<a,and p(x)=0 _ otherwise. 


A uniform probability distribution , 


t. for -a<x<a 
a 


P(x) = ; 
0 otherwise 


for which there exist many examples, gives 


I re 1 1 a 
f(k) = ae exp(—ikx) dx = 50 wig OPC) 


—a 


1 . (ak)?" 
= — k — |)” 
aE sin(ka) = om 1) Qm+D! 
Therefore, 


1 
m, = (x) =0, and my, = (x°) = rue 


(b) Laplace p(x) = 5. | exp(— ul), 
The Laplace PDF, 


for example describing light absorption through a turbid medium, gives 


fi) = = [- dx exp (—ine- a) 


1 f° : 1 /° . 
= — | dx exp(—ikx— x/a)+ — | dxexp(—ikx+ x/a) 
2a Jo 2a Joo 


a4 1 1 ol 
~ 2a eae si) 1+ (ak)? 
= 1— (ak)? + (ak)* - 


Therefore, 
m, = (x) =0, and my = (x*) = 2a’. 
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(c) Cauchy p(x) = 


The Cauchy, or Lorentz, PDF describes the spectrum of light scattered by diffusive 


modes, and is given by 


p(x) = me +a)’ 


For this distribution, 


f(®~) = [ : exp(—ikx) pea dx 


1 oe 1 1 
—— ik d 
sma | xP ‘ of sal : 


The easiest method for evaluating the above integrals is to close the integration 


contours in the complex plane, and evaluate the residue. The vanishing of the integrand 
at infinity determines whether the contour has to be closed in the upper or lower half 


of the complex plane, and leads to 


1 exp(—ikx) 
5A | ai dx = exp(—ka) fork > 0} 


Cc 
f=) jecity = exp(—|kal). 


- dx = exp(ka) fork <0 
271i JB 


x—1la 
Note that f(k) is not an analytic function in this case, and hence does not have a Taylor 
expansion. The moments have to be determined by another method, for example, by 
direct evaluation, as 
2 
m, = (x) = and = (x’) = [ ax dx = oe > co. 

The first moment vanishes by symmetry, while the second (and higher) moments 
diverge, explaining the non-analytic nature of f(k). 

The following two probability density functions are defined for x > 0. Compute 
only the mean and variance for each. 
Rayleigh p(x)=3 © exp(—#5). 

The Rayleigh distribution, 


2 
P(x) = = exp (-) ; for x>0, 


can be used for the length of a random walk in two dimensions. Its characteristic 


(d 


Naw] 


function is 


oo 2 
fk) =f exp( ikx) exp =) dx 


=f] [cos(kx) —isin(kx)] = = exp(- 5) dx. 


The integrals are not simple, but can be evaluated as 


oo x x & (-1)"n! ai an 
[ cos(kx) “= exp (-=5) dx=)> any (2a’k’)", 


n=0 
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and 


oo “ 2 
i sin(kx) exp|—> 


x 1rre. x x 

me dx = 7 sin(kx) | exP( —5 5 dx 
[ar ( ) 

=,/—ka exp | —-—— ], 
2 2 


resulting in 


The moments can also be calculated directly, from 


m=()=[" Se(-25) a x= [= 2a * pes (~35) -|F« 
= (2) = [" Sew(- X) avn2e [” 2 sak P( +) & 


= 20° | yexp(—y) dy = 2a’. 


a 


) 


(e) Maxwell p(x) = Ree exp(—5). 


It is difficult to calculate the characteristic function for the Maxwell distribution 


td 2x x? 
x) =,/—— exp|—-—, }. 
P Tae P 2a? 


say describing the speed of a gas particle. However, we can directly evaluate the 
mean and variance, as 


OO aa oa x? 
m, = (x)= eh Pe a eT dx 
a2 
=2/* af” oF =e ( - ~)a(3) 
f 2 pe /2 
=). =af yexp(—y) dy = 2,/ —a, 
tT Jo 7 


and 


m=(e)=\2 [* Sen/ £) ar=3e. 
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2. Directed random walk: the motion of a particle in three dimensions is a series of inde- 
pendent steps of length ¢. Each step makes an angle 6 with the z axis, with a probability 
density p(0) = 2cos*(6/2)/7, while the angle ¢ is uniformly distributed between 0 and 
277. (Note that the solid angle factor of sin 6 is already included in the definition of p(@), 
which is correctly normalized to unity.) The particle (walker) starts at the origin and 
makes a large number of steps NV. 


(a) Calculate the expectation values (z), (x), (y), (2”4, (x’), and (y"), and the covariances 
(xy), (az), and (yz). 
From symmetry arguments, 


(x) = (y) = 9, 


while along the z axis, 


Na 
(2) = Dizi) = N(zi) = Na (cos 6;) = >. 
The last equality follows from 


w 1 

(cos 6,) = | p(8)cosado = [ — cos @- (cos 8+ 1) dé 
0 7 

= [= (cos20+ 1) a0 = > 

Jo Qa ~ 2° 


The second moment of z is given by 
= Dkal= LO bal+ LE 
=k » (i) fe) (ei) 
= MN — 1) (z;)? +N (22). 


Noting that 


(zi) 


1 
a > 


= i = cos” 6(cos 0+ 1) d@ = i  teasd6 1)dé@= — 

0 7 0 27 2 
we find 

(22) = M(N = 1) (2) +0 =N(N+ i. 
2 2 4 
The second moments in the x and y directions are equal, and given by 
(r= » (ey) =o db) +20 (x7) =N (xi). 
i, i iAj i 


Using the result 


(x?) 


Pa (sin? Ocos” ¢) 


1 2a 7 
/ d¢ cos” 6 dé sin’ 6(cos +1) = 
0 0 


_ 1 
~ Qa? 4’ 
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we obtain 


While the variables x, y, and z are not independent because of the constraint of 
unit length, simple symmetry considerations suffice to show that the three covariances 


are in fact zero, that is, 


(xy) = (xz) = (yz) =0. 


(b) Use the central limit theorem to estimate the probability density p(x, y, z) for the 
particle to end up at the point (x, y, z). 

From the central limit theorem, the probability density should be Gaussian. How- 

ever, for correlated random variables we may expect cross terms that describe their 

covariance. However, we showed above that the covariances between x, y, and z are 


all zero. Hence we can treat them as three independent Gaussian variables, and write 


@-@®)P _O- OY eo"). 


202 20; 20? 


P(x, y, Z) «exp 


(There will be correlations between x, y, and z appearing in higher cumulants, but 


all such cumulants become irrelevant in the N — limit.) Using the moments 


(x)=(y)=0, and (z)= Ne 


2 2 2 
and o2 = (2) (2) = MN +15 (=) =n" ; 


we obtain 


7 e aes 3/2 - 242+ (z—Na/2) 
Nae Na2/2 
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3. Tchebycheff inequality: consider any probability density p(x) for (—co < x < 0), with 
mean A, and variance a”. Show that the total probability of outcomes that are more than 


no away from A is less than 1/n’, that is, 


1 
/ dxp(x) < >. 
|jx-A|=no n 


Hint. Start with the integral defining o*, and break it up into parts corresponding to 
|x —A| > no, and |x—A| < no. 


By definition, for a system with a PDF p(x), and average X, the variance is 


c= / (x — A)? p(x) dx. 
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Let us break the integral into two parts as 


= | (x—A)2p(x) dx + (x—A)2p(x) dx, 
|jx-Al=no7 


|x-A|<no 


resulting in 


Ge F syeaa —APp(sdx= fo (x= A)p(a) ae. 


|jx-A|=no7 


Now since 
hia ~ A)’p(x) dx > Fong PO) dx, 
we obtain 
ia Ee Sa = / =A (x—A)’p(x) dx < 0°, 
and 


1 
[ p@arss. 
|x-Al=no n 
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. Optimal selection: in many specialized populations, there is little variability among the 
members. Is this a natural consequence of optimal selection? 


(a) Let {r,} be n random numbers, each independently chosen from a probability density 
P(r), with r € [0, 1]. Calculate the probability density p,,(x) for the largest value of 
this set, that is, for x = max{r,,--- ,7,}. 

The probability that the maximum of n random numbers falls between x and x+dx 
is equal to the probability that one outcome is in this interval, while all the others 


are smaller than x, that is, 


nid=Pinarnennencn<ax("). 


where the second factor corresponds to the number of ways of choosing ry = Xx. 


As these events are independent, 
n 
Pa(X) = P(r, =X): PUI < ¥): Pts <3)-+- PM <x) x (7) 
n-1 n 
=p(r=a)[p(r< aI" x(7). 


The probability of r < x is just a cumulative probability function, and 


x n—1 
pod =n-p)-| [par] 
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(b) If each r, is uniformly distributed between 0 and 1, calculate the mean and variance 
of x as a function of n, and comment on their behavior at large n. 


If each r, is uniformly distributed between 0 and 1, p(r) = 1 Ch p(r)dr = ch 
dr = 1). With this PDF, we find 


Hae: | f “par] - | [ vw] ane 


and the mean is now given by 


n 
n+1° 


1 1 
(x) = | xp, (x) dx = nf x"dx= 
0 0 


The second moment of the maximum is 


resulting in a variance 


. n n \? n 
2 fy\_ fy\2 = = . 
Cae n+2 (=) (n+ 1)?(n+2) 


Note that for large n the mean approaches the limiting value of unity, while the 


variance vanishes as 1/n*. There is too little space at the top of the distribution for 


a wide variance. 
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5. Benford’s law describes the observed probabilities of the first digit in a great variety of 


data sets, such as stock prices. Rather counter-intuitively, the digits 1 through 9 occur with 
probabilities 0.301, 0.176, 0.125, 0.097, 0.079, 0.067, 0.058, 0.051, 0.046, respectively. 
The key observation is that this distribution is invariant under a change of scale, for 
example, if the stock prices were converted from dollars to Persian rials! Find a formula 
that fits the above probabilities on the basis of this observation. 

Let us consider the observation that the probability distribution for first integers is 
unchanged under multiplication by any (i.e., a random) number. Presumably we can 
repeat such multiplications many times, and it is thus suggestive that we should consider 
the properties of the product of random numbers. (Why this should be a good model for 
stock prices is not entirely clear, but it seems to be as good an explanation as anything 
else!) 


Consider the x = Te r,, where r; are positive, random variables taken from some rea- 
sonably well-behaved probability distribution. The random variable € = \nx = ye ,inr; 
is the sum of many random contributions, and according to the central limit theorem 


should have a Gaussian distribution in the limit of large N, that is, 


a 1 


li l)= , 
Jim, pC ) oo INo2 >=No2 
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where € and o° are the mean and variance of \n r, respectively. The product x is distributed 


according to the log-normal distribution 


Peo) = POL = =| 


The probability that the first integer of x in a decimal representation is i is now obtained 


approximately as follows: 
p= f  dxp(). 


The integral considers cases in which x is a number of magnitude 10% (i.e., has q+ 1 
digits before the decimal point). Since the number is quite widely distributed, we then have 
to sum over possible magnitudes q. The range of the sum actually need not be specified! 


The next stage is to change variables from x to £ = \nx, leading to 


a9 
gtin(i+1) q+in(i+1) (¢ _ Ne) 1 

‘= dep(e) => | dlex 

. 2 a PO 2 +ni P| 2No? V27No2 


q q 


We shall now make the approximation that over the range of integration (q+ ni to 
q+ In(i+ 1)), the integrand is approximately constant. (The approximation works best 


for q® Ne where the integral is largest.) This leads to 


x (q=Ne) feat eshidiee lal tas 
px Deve] | eli +)—tmidocin(1+7), 


where we have ignored the constants of proportionality that come from the sum over 


q. We thus find that the distribution of the first digit is not uniform, and the properly 
normalized proportions of In(1+1/i) indeed reproduce the probabilities p,,--- , py of 
0.301, 0.176, 0.125, 0.097, 0.079, 0.067, 0.058, 0.051, 0.046 according to Benford’s law. 
(For further information check http://www.treasure-troves.com/math/BenfordsLaw. html; 
and for an alternative view the article by T. P. Hill, American Scientist 86, 358 (1998).) 
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. Information: consider the velocity of a gas particle in one dimension (—oo < v < 00). 


(a) Find the unbiased probability density p,(v), subject only to the constraint that the 
average speed is c, that is, {|v]) =. 

For an unbiased probability estimation, we need to maximize entropy subject to 

the two constraints of normalization, and of given average speed ((|v|) = c.). Using 


Lagrange multipliers a and B to impose these constraints, we need to maximize 


5 == (inp) =~ J poyinp(wyau-+a(1~ f pyar) 


+B Gamo av) , 
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Extremizing the above expression yields 


a) = —Inp(v)—1-—a—B|v| = 0, 
which is solved for 
In p(v) = —l—a— Blo}, 
or 
p(v) = Ce Fl", with C=e!*, 


The constraints can now be used to fix the parameters C and B: 


l= / P(v) du= / Ce All dv= 2c f e PY dv= aC a e P = B ‘ 
—co 55 A 


which implies 


NID. 


From the second constraint, we have 
co co 
c= / Ce Flu| du = B/ e P’udy, 
00 0 


which when integrated by parts yields 


1 ot Fe 1 oo 1 
c=p| —Jue* += eau] =[-5 els |= 5. 
B o B40 B B 
or, 
1 
pa, 
c 


The unbiased PDF is then given by 


1 
p(v) = Ce F"! = — exp (-") ; 
2c c 


(b) Now find the probability density p,(v), given only the constraint of average kinetic 
energy, (mv?/2) = mc?/2. 
When the second constraint is on the average kinetic energy, (mv? /2) = mc? /2, we 


have 


mc? — m 


s=- [7 reympoyarta(1—f~ royan)+e("2—[” pean). 


The corresponding extremization, 


os 
apt) In p(v) —l1-a-—B =0, 
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results in 


p(v) = Cexp (- a) “ 


The normalization constraint implies 


l= i. p(v) dv = os eo Bmv?/2 CV 27/Bm, 


or 


= /Bm/27. 


The second constraint, 


maf. pv) av = |B [ex xp (-E) raw 


a) aoe ye (7) ‘|- e 


gives 


for a full PDF of 


Bmv? 1 v 
=C = ‘ 
P(v) exp ( 5 aa exp 52 


(c) Which of the above statements provides more information on the velocity? Quantify 


the difference in information in terms of J, — I, = ((In p,) — (In p,)) /1n2. 
The entropy of the first PDF is given by 


S, = —(Inp,) = [xe0(=)[ In(2c) | aw 
=!29 (ep) aoe! [on(-2) 20 


1 
=~ In(2c) exp(—v/0)|f? + = [-¢ exp(—v/e) 


= In(2c)+1=1+1n2+Inc. 


For the second distribution, we obtain 


eee re a phen) 


In (2c? ) [ po tao de Sane 
= ——— exp (—v°/2c’) du+ —f > 5 exp ( uv’ /2c°) du 
2V 271? 7c ( ) V 210? 2c? ) 
1 1 V 21027 
=<-In (27c’) + = 
2 Cv 27? 2 


1 1 1 1 
=5 In (27c’) + 5 - 5 In(27r) + Inc. 
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For a discrete probability, the information content is 
I, =ln, M—S,/1n2, 


where M denotes the number of possible outcomes. While M, and also the proper 
measure of probability, are not well defined for a continuous PDF, the ambiguities 


disappear when we consider the difference 


I,-—1, = (—S,+ S,) /In2 


= —(S,—S,) /1In2 
(in 7 — In2—1) 
= —-——____—— _* 0.3956. 
21n2 


Hence the constraint of constant energy provides 0.3956 more bits of information. 
(This is partly due to the larger variance of the distribution with constant speed.) 
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Solutions to selected problems from 
chapter 3 


1. One-dimensional gas: a thermalized gas particle is suddenly confined to a one-dimensional 


trap. The corresponding mixed state is described by an initial density function p(q, p, t= 
0) = 8(q)f(p), where f(p) = exp(—p?/2mk,T)//2amk,T. 


(a) Starting from Liouville’s equation, derive p(q, p, t) and sketch it in the (q, p) plane. 


Liouville’s equation, describing the incompressible nature of phase space density, 


is 
dp .0p .dp OH 0p dH dp 
Sy, =p. = =f =—{p, H}. 
Ot 0q op Op 0q 0g Op 
For the gas particle confined to a one-dimensional trap, the Hamiltonian can be 
written as 
2 2 
P P 
HAH = — V = =; 
2m + V4.) 2m 


since Vo, = 0, and there is no motion in the y and z directions. With this Hamiltonian, 


Liouville’s equation becomes 


whose solution, subject to the specified initial conditions, is 


pq Pp, t) = p(a- =, DP; 0) =6 (4- *') f(p). 


*P 


t=0 


So 
Qv 


/ 


slope m/t 
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2 2 


(b) Derive the expressions for the averages (q ) and (p ) at t > 0. 


The expectation value for any observable O is 


(0) = [ drop, 9, 


and hence 
(p= / P f(p)d (4 - = 1) dp dq= / Pp’ f(p)dp 


0 2 
= dp p” 


Pp 


1 
exp ( 
J27mk pT 2mk pT 


) = mk,T. 
Likewise, we obtain 
(7°) = [ #10)8 (4-41) ap aq = [ (21) royap 


=( ) [Prep = zy 


t 
m 


(c 


YS 


Suppose that hard walls are placed at g = +Q. Describe p(q, p, t>> T), where 7 is an 
appropriately large relaxation time. 


With hard walls placed at q = +Q, the appropriate relaxation time T is the char- 
acteristic length between the containing walls divided by the characteristic velocity 
of the particle, that is, 

20 20m m 


~ = =2 . 
ld NT 


Initially p(q, p, t) resembles the distribution shown in part (a), but each time the 


particle hits the barrier, reflection changes p to —p. As time goes on, the slopes 
become less, and p(q, p, t) becomes a set of closely spaced lines whose separation 
vanishes as 2mQ/t. 


v 


an 


wy 


(d) A “coarse-grained” density p is obtained by ignoring variations of p below some 
small resolution in the (q, p) plane; for example, by averaging p over cells of the 
resolution area. Find p(q, p) for the situation in part (c), and show that it is stationary. 
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We can choose any resolution € in (p,q) space, subdividing the plane into an 
array of pixels of this area. For any &, after sufficiently long time many lines will 


pass through this area. Averaging over them leads to 
Bl. pst > 1) = fin) 
.Pt>T)= , 
P\Q P 20° P 


as (i) the density f(p) at each p is always the same, and (ii) all points along q € 
[—Q,+Q] are equally likely. For the time variation of this coarse-grained density, 


we find 


Op Op 
gee =0, that is, p is stationary. 


Ot m 0q 
ok KKK KK KK 


2. Evolution of entropy: the normalized ensemble density is a probability in the phase space 
I. This probability has an associated entropy S(t) = — f dIp(T, 1) In p(T, 2). 


(a) Show that if p(T, f) satisfies Liouville’s equation for a Hamiltonian H, dS/dt = 0. 
The entropy associated with the phase space probability is 


s() = — f alp(C, t)inp(F, 1) = = (inp (I, 0). 
Taking the derivative with respect to time gives 
dS dp 1 dp 
=-far(21 Jars ar? (np +1 
dt / (4 ed =£)= 7 (np +1). 


Substituting the expression for dp/dt obtained from Liouville’s theorem gives 


dp 0H = dp 0H 
ey ry TO OE ioc, 
Op; 9g; — 9q; OD; 


(Here the index i is used to label the three coordinates, as well as the N particles, 


and hence runs from 1 to 3N.) Integrating the above expression by parts yields! 


NT 8 (AH 0 (dH 
—= fdr —(— (1 1))-p—[{ —a 1 
| von (a ae )) ra (G aa )| 


! This is standard integration by parts, that is, i, FdG = FG|;, -— te GdF. Looking explicitly at 
one term in the expression to be integrated in this problem, 

ves OFC dp eee 

f Flav =) dads: dgidp;---ddswdPaw a a 


we identify dG = dq; _ and F with the remainder of the expression. Noting that p(q;) = 0 at 
the boundaries of the box, we get 


3N 3N 
Op 0H 0 OH 
/Tlev.50 5 =—f Teves 

= dq; OD; i=l dq; OD; 
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(b) 


(c 


YS 


(d) 


Gp] =p. 
4q; p OP; O aG.aP, Op; p 9q; 


I 


H 0H 1 0, PH 0H 10 
(Inp+1)+p : 2] 


3N 2 
= ary le a 
i=l 


fa) 


04; op i op i 04; 
Integrating the final expression by parts gives 


S=-fa ry.|-» PH “|= 


+p 
i=l op ,0a; 


dg,9D; 


Using the method of Lagrange multipliers, find the function p,,,,, (I) that maximizes the 
functional S[p], subject to the constraint of fixed average energy, (H) = f dIpH = E. 
There are two constraints, normalization and constant average energy, written 


respectively as 
/ dip(T)=1, and (#)= / dl p(0)H = E. 
Rewriting the expression for entropy, 
S() = / dIp(L) [—Inp(L) —a—- BH] +04 BE, 


where a and B are Lagrange multipliers used to enforce the two constraints. Extrem- 


izing the above expression with respect to the function p(T) results in 
os 
dp(T) 


The solution to this equation is 


=—Inpmax(T) —@ — BH(T)-1=0 


P=Pmax 


In Prax = —(a+ 1) — BH, 
which can be rewritten as 
Pmax = Cexp(—BH), where C=e@*, 


Show that the solution to part (b) is stationary, that is, 0p,,,,/dt =0 


The density obtained in part (b) is stationary, as can easily be checked from 


Op... 
— = {Pmax> KH} = joer +| 
OH OH OH OH 
=< c(-B) = eet C(-B) —e * =0, 
ap aq dp 


How can one reconcile the result in (a) with the observed increase in entropy as 
the system approaches the equilibrium density in (b)? (Hint. Think of the situation 
encountered in the previous problem.) 

Liouville’s equation preserves the information content of the PDF p(T, t), and hence 
S(t) does not increase in time. However, as illustrated in the example in Problem 
1, the density becomes more finely dispersed in phase space. In the presence of 
any coarse graining of phase space, information disappears. The maximum entropy, 
corresponding to p, describes equilibrium in this sense. 
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3. The Vlasov equation is obtained in the limit of high particle density n = N/V, or large 
interparticle interaction range A, such that nA? > 1. In this limit, the collision terms are 
dropped from the left-hand side of the equations in the BBGKY hierarchy. 


The BBGKY hierarchy 


a - Pn d : dU 9V(Gn — 41) 0 
tn Fi = (5 + aa, ) a, | 


at n=1 mm 94, n=1 n 1 
OV (Gg, —4 0 
=> fav, (Gn = As41) | O41 
n=1 o4, OPn 
has the characteristic time scales 

1 oU a v 

Ty dq dp L 

1 ove v 

tT. Og Op Nr 

| Zicifae B tint ae 
Ty aq Op ff, t 


where nA? is the number of particles within the interaction range A, and v is a typical 
velocity. The Boltzmann equation is obtained in the dilute limit, nA? < 1, by disregarding 
terms of order 1/7, < 1/7,. The Vlasov equation is obtained in the dense limit of nA? >> 1 


by ignoring terms of order 1/7, « 1/T,,.. 
(a) Assume that the N-body density is a product of one-particle densities, that is, p = 
TI, 91 (x;, 2), where x; = (B;, Gi). Calculate the densities f,, and their normalizations. 
Let x; denote the coordinates and momenta for particle i. Starting from the joint 
probability py =|”, p,(x,, 8), for independent particles, we find 


f= iq dV. Py = Wo Ll us Xyot 


a=s+1 n=1 


Ga 


The normalizations follow from 
[atp=1, — [Vip =1, 


and 


N! 
/ Il dV, ~ NS for s<N. 
n=1 ~~ (N=s)! 
(b) Show that once the collision terms are eliminated, all the equations in the BBGKY 


hierarchy are equivalent to the single equation 


[5+2. fe | AG 79 =6 


where 


Usd.) =UG)+ f ax'VG—4) fA, 0. 
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Noting that 


Sort a (N—s)! 
_. Woaet! 


(X54) ) > 


the reduced BBGKY hierarchy is 


ofp. @ 80 2 
ath (eee) |s 
t n=1 m adn O4n OP, 


a y|/ dV, eo) 


5 (W-fipils)] 


n 


0 


0 
I4n Da 


op 


Ss 
agp a 


n=1 


[/ dV, 401 (X41) V (Gn — I-41)" y| 


n 


where we have used the approximation (N — s) © N for N > s. Rewriting the above 


0 ’ (?p 0 aU, 0 
+ (2. a ne 5 i ) f,=9, 
at n=1 m IG I4n OP, 


Use = UG) +N [ AV'VG—F) 018.9. 


expression, 


where 


(c) Now consider N particles confined to a box of volume V, with no additional potential. 
Show that f,(q, Pp) = g(p)/V is a stationary solution to the Vlasov equation for any 
g(p). Why is there no relaxation toward equilibrium for g(p )? 


Starting from 
p: = 8(P)/V. 
we obtain 
N D; 2 . 
KE ope = d E + Ua] , 
with 


/ a 1 > N > 
Us =0+N [ aV'VG—-G) 8) => [ aVG). 


(We have taken advantage of the normalization f ad’ pg(p) = 1.) Substituting into the 


rr ee ee 
oom ge 


There is no relaxation toward equilibrium because there are no collisions that 


Vlasov equation yields 


allow g(p) to relax. The momentum of each particle is conserved by KH 4; that is, 
{p,, Hg} =0, preventing its change. 
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4. Two-component plasma: consider a neutral mixture of N ions of charge +e and mass m,, 
and WN electrons of charge —e and mass m_, in a volume V = N/no. 


(a) Show that the Vlasov equations for this two-component system are 


(fob 4, Ae A], 2 - 
“= a 5g,t =0 
[Li i oe A. 48) 


e. 2a oa a 
. ,t)=0 
[ate eget S| LGD 


where the effective Coulomb potential is given by 


Gy (G1) = BalG) +e f ax CG-G)[A..)-F-0,9)]. 


Here, ®.,,, 
C(q) satisfies the differential equation V7C = 47763(q). 


is the potential set up by the external charges, and the Coulomb potential 


The Hamiltonian for the two-component mixture is 


H = y| e+ +P |e Megat 


2m 
i,j=l 


+ > e; iPox (Gi) 
qj| i=1 


where C(q;— 94;) = 1/l4; — 4;|. resulting in 


OH Pasi 
agi "0G; 


+e Lege C(4;- 4))- 
J#i 


Substituting this into the Vlasov equation, we obtain 


([2 p 9 yy A 


—. p,q, t)=0 
ate ates 3 |f6.a.0 


+ 


0 Pp 2a OD ore 
. => e = 
(Lor m_ oq oq 


0 Sok 
Z| Han =0 


(b) Assume that the one-particle densities have the stationary forms f, = 9,(p)ns(q). 


Show that the effective potential satisfies the equation 


VD ete = ATPext +47e (nq) or n_(q )) ? 


where p,,, is the external charge density. 


Setting f.(p,q) = g.(p)ni(q), and using [ @pg.(p) = 1, the integrals in the 
effective potential simplify to 


ue (G.1) = By +e f PG CGF [n.G)—2_@)]. 


Apply V* to the above equation, and use V?®,., =4 7p... and V°C(q—q ') = 476? 
(q—q'), to obtain 


V? Petr = ATPext +4rre [n,(q) ~ n_(q ) 
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(c) Further assuming that the densities relax to the equilibrium Boltzmann weights 


(d 


(e 


New 


— 


ns(q) = ny exp[+Be®,;,(g)] leads to the self-consistency condition 
v2 Dp = 47 [ext +inge (cee = e Peter] 


known as the Poisson—Boltzmann equation. Due to its non-linear form, it is generally 
not possible to solve the Poisson—Boltzmann equation. By linearizing the exponentials, 


one obtains the simpler Debye equation 
V> Pete = ATPext + D;/d?. 


Give the expression for the Debye screening length X. 


Linearizing the Boltzmann weights gives 


+ =N, exp[ FBeP.r(q)] © 1, [1 F Beare] , 


= 


resulting in 


1 
Vv Dep = AT Pex. =F 2 Dy, 


with the screening length given by 


= 


=> 5 rs 
870N,e 


Show that the Debye equation has the general solution 
(G9) = | PY CG -F)Pew@’), 


where G(q) = exp(—|q|/A)/|q| is the screened Coulomb potential. 


We want to show that the Debye equation has the general solution 
(9) = [| PUCG-F')Peu(7), 


where 


agy= CH, 


Effectively, we want to show that V?G = G/d for q #0. In spherical coordinates, 


G =exp(—r/A)/r. Evaluating V? in spherical coordinates gives 


voi 4 (-%) = 1 23/ lew *) 


r2 or or r2 or A r r2 

1/1 1 1 lew G 
_ —r/X —r/Xr —r/A}_ = 
=a|y7 ae |-z oe 


Give the condition for the self-consistency of the Vlasov approximation, and interpret 


it in terms of the interparticle spacing. 
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The Vlasov equation assumes the limit n,A° >> 1, which requires that 


(kT)? 2 n-th 
1S Kn 8, 
ne” kr 


where € is the interparticle spacing. In terms of the interparticle spacing, the self- 
consistency condition is 
2 


e 
7< kT, 


that is, the interaction energy is much less than the kinetic (thermal) energy. 
(f) Show that the characteristic relaxation time (7 ~ A/v) is temperature-independent. 
What property of the plasma is it related to? 


A characteristic time is obtained from 


A kpT m m 1 
TYLA : ~ ~, 
v noe VY kpT ne W, 


where w,, is the plasma frequency. 


2k ok 2k 2k 2K 2k KK 


5. Two-dimensional electron gas in a magnetic field: when donor atoms (such as P or As) 
are added to a semiconductor (e.g., Si or Ge), their conduction electrons can be thermally 
excited to move freely in the host lattice. By growing layers of different materials, it is 
possible to generate a spatially varying potential (work-function) that traps electrons at 
the boundaries between layers. In the following, we shall treat the trapped electrons as a 
gas of classical particles in two dimensions. 

If the layer of electrons is sufficiently separated from the donors, the main source of 


scattering is from electron—electron collisions. 


(a) The Hamiltonian for non-interacting free electrons in a magnetic field has the form 


(<i) 


Pi s 
5g ae 


(The two signs correspond to electron spins parallel or anti-parallel to the field.) The 
vector potential A=Bx q/2 describes a uniform magnetic field B. Obtain the classical 
equations of motion, and show that they describe rotation of electrons in cyclotron 
orbits in a plane orthogonal to B. 


The Hamiltonian for non-interacting free electrons in a magnetic field has the form 


3\2 
(7, a eA) m 
lee mr ae 2 


or in expanded form 


Pp es 3 Care z 
H = —+—p-A+—A°+uyn,|BI. 
2n m 2m 
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Substituting A = Bx G/2, results in 


2 e 


Pp e > 
H=-~!+-—p-B —(B 4) + B 
a aa Pp: XGte xq) =p,|B 
Pp 2-9 = 
-/4—5xB. aay ~(B- gE: Bl. 
ee px gare (B-q) )+ug|Bl 


Using the canonical equations, q =dH/p and p = —dH /q, we find 


5 0H p e S es 
C= ae Vag —= p=mq-—-~Bxq, 
Dp m 2m 2 
po th Lae (Ba) 

= x . 
|? q Im? 4m!" 4m _ 


Differentiating the first expression obtained for p, and setting it equal to the second 


expression for p above, gives 


Simplifying the above expression, using B x @ x B = B°q— (B- 7) B, leads to 
mq = eB x q. 


This describes the rotation of electrons in cyclotron orbits, 


where @,. = eB/ m; that is, rotations are in the plane perpendicular to B. 

(b) Write down heuristically (i.e., not through a step-by-step derivation) the Boltzmann 
equations for the densities f,(p, q, t) and f, (p,q, t) of electrons with up and down 
spins, in terms of the two cross-sections 0 = On =O); and o,, = Or of spin- 
conserving collisions. 

Consider the classes of collisions described by cross-sections 0 = 04, = 0, and 


0,, =0},. We can write the Boltzmann equations for the densities as 


0 
Th _t9¢,, f,)=[ @pdO - ol {SF Lis )Fy (Br) — Fy BL] 
[fA - ADA, || ; 
and 
af, 


(at. f}=f Prato, — val | Fis Wi )- LONI] 


+E Ls We 0- HGI 
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(c) Show that dH/dt < 0, where H = H, +H, is the sum of the corresponding H-functions. 
The usual Boltzmann H-theorem states that dH/dt < 0, where 


H= [ Pad? pf, 7.)nfG dB. ). 
For the electron gas in a magnetic field, the H-function can be generalized to 
H= [ @adp[f,inf,+ fmf]. 


where the condition dH/dt < 0 is proved as follows: 


dH; . [af af 
= =| Pad’ [= (nf, +1) + + (Inf, + i] 


= d?qd? p[(In f, +1) {fp Hy} +O + Cy) 


+(Inf, +1) ({f,, Hy} 4+Cy +4) 1, 


with C,,, etc., defined via the right-hand side of the equations in part (b). Hence 
dH Fee 
a i gdp (Inf, +1) (Cyp + Cn) + (Inf, +1) (Cy + Cy4) 
= [ Pad?p (Inf, +1) Cy, + (Inf, +1) Cy, 


+(Inf, +1) Cy + (Inf, +1) Cy, 
= i Oe gd ( 
dt dt dt 
where the H’s are in correspondence to the integrals for the collisions. We have also 
made use of the fact that f d° pd?q {Fas H,} = [pd {fy H | =0. Dealing with 
each of the terms in the final equation individually, 


dH do ae s7 
SH = | aga? pid? pd Qn, — v9) (Inf, +1) 5 LiF Be) 


Hy) +H), 


— fy, Pdf; Pr) 1. 
After symmetrizing this equation, as done in the text, 


dH _ 


1 242 42 do = - =) > 
qt =a Gf Pad? ri? pd Qn, — v2] [In fy Bf (Be) — Inf.) Fy B)] 


. [fs (Pi)f; (P2) — ty (Pi) fy (P)] <0. 
Similarly, dH, |/dt < 0. Dealing with the two remaining terms, 


dH) _ 


qt = | Pad" pa? p,dO|v, — vs| [In f,@,) +1] 


d > 4) > > 
Se BLP) - Bf, 0)] 
=| d’ gd’ pd’ p,dQ|v, — vy| [In f, (p,) + 1] 


d . S 5 S 
Se CAC ee CACO 
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where we have exchanged (P,, P> <> P, Py). Averaging these two expressions together, 


ee =n f Bad? re pad lo, ~ vg] 52> [In FB.) — 19 F,65)] 
TACT ERU VACATE 
Likewise, 
dH, 


1 d 4 ~ 
Ht = f Pad? pid? p,dOlv, — vo] 5 [In f, (Bs) —n F,(B)] 
. [f, (Po) f, (Pr) -f, @)/,@)] : 


Combining these two expressions, 

d 1 Be saDi ad do 
a y+ Hy) a -;fa qd" pd" p,dQ|v, — v9| Tl 
[In f, (Pf, (Br) —Inf, (Pi) f,(P)] [fs (PF, (Pr) — fA. PO)F PM ] <0. 


Since each contribution is separately negative, we have 


dH dH,, dH, d 
= H H,,) <0. 
dt de ae a (Hy + Hy) s 


(d) Show that dH/dt = 0 for any Inf that is, at each location, a linear combination of 


me 


quantities conserved in the collisions. 

For dH/dt = 0 we need each of the three square brackets in the previous derivation 
to be zero. The first two contributions, from dH,,/dt and dH,,/dt, are similar to 
those discussed in the notes for a single particle, and vanish for any \n f that is a 


linear combination of quantities conserved in collisions 
In fo = 2) 4; (Q)xi(P), 
where a=(t or J). Clearly at each location q, for such f,., 


In f.(P1) +n fy (P2) = In fo (P)) +n fy (D5 : 


If we consider only the first two terms of dH/dt = 0, the coefficients a*(q) can vary 
with both q and a=(t or J). This changes when we consider the third term 
d (H, , +H wy) /dt. The conservations of momentum and kinetic energy constrain the 
corresponding four functions to be the same, that is, they require a} (q) = a} (9). 
There is, however, no similar constraint for the overall constant that comes from 
particle number conservation, as the numbers of spin-up and spin-down particles are 
separately conserved. This implies that the densities of up and down spins can be 
different in the final equilibrium, while the two systems must share the same velocity 


and temperature. 


(e 


wm 


Show that the streaming terms in the Boltzmann equation are zero for any function 
that depends only on the quantities conserved by the one-body Hamiltonians. 
The Boltzmann equation is 


af 


at = {fas Hg} + Coa + Cag: 


(f) 
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where the right-hand side consists of streaming terms {f, H ,}, and collision terms C. 
Let I; denote any quantity conserved by the one-body Hamiltonian, that is, {I;, 4} = 
0. Consider f,,, which is a function only of the I,’s 


fa = fo is s+ ++). 
Then 
Of 
{fas Ha} = La {1j: Fal =0 
~ ol, 
ae) 
Show that angular momentum L= q x pis conserved during, and away from, collisions. 


Conservation of momentum for a collision at q 
(P; + Pr) = (Pi +P), 
implies 
qx (P+ Pr) = 4X (Pi +P), 
or 
Lith =L 4, 


where we have used L, = q xX p;. Hence angular momentum L is conserved during 
collisions. Note that only the z component L, is present for electrons moving in two 
dimensions, q = (x, X>), as is the case for the electron gas studied in this problem. 


Consider the Hamiltonian discussed in (a) 


2 2 

Dp e, 2, @& >, > 
= 2 + Spx B-g+— (Bq? -B-G)*) tual Bl. 

2m 2m 8m 


Let us evaluate the Poisson brackets of the individual terms with L, = q x p fs The 


first term is 


ee 0 
_ {|p é qx Pp} = Eiix {p.P). x;Px} a ©ie2P1 5 (Px) = 2€,P)/P, =9, 
1 


where we have used &;.P;P,; = since p;P, = PyP; 18 symmetric. The second term is 


proportional to L.,, 
{px B-a.L.| = {B.L,,L,} =0. 


The final terms are proportional to q’, and {?, qx p} = 0 for the same reason that 


{p.4axp} = 0, leading to 
{3,.¢«p}=0. 


Hence angular momentum is conserved away from collisions as well. 
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(g) 


(h) 


(i) 


Write down the most general form for the equilibrium distribution functions for 
particles confined to a circularly symmetric potential. 

The most general form of the equilibrium distribution functions must set both the 
collision terms, and the streaming terms, to zero. Based on the results of the previous 


parts, we thus obtain 


Sei ra Ag exp [-BH, ~ yL.] ke 


The collision terms allow for the possibility of a term —u- p in the exponent, correspond- 
ing to an average velocity. Such a term will not commute with the potential set up by a 
stationary box, and is thus ruled out by the streaming terms. On the other hand, the angu- 
lar momentum does commute with a circular potential {V@Q), L} = 0, and is allowed by 
the streaming terms. A non-zero y describes the electron gas rotating in a circular box. 
How is the result in part (g) modified by including scattering from magnetic and 
non-magnetic impurities? 

Scattering from any impurity removes the conservation of p, and hence L, in colli- 
sions. The y term will no longer be needed. Scattering from magnetic impurities mixes 
populations of up and down spins, necessitating A, = A,; non-magnetic impurities do 
not have this effect. 

Do conservation of spin and angular momentum lead to new hydrodynamic equations? 

Conservation of angular momentum is related to conservation of Pp, as shown in 
(f), and hence does not lead to any new equation. In contrast, conservation of spin 
leads to an additional hydrodynamic equation involving the magnetization, which is 


proportional to (n,—n,). 
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6. The Lorentz gas describes non-interacting particles colliding with a fixed set of scatterers. 


It is a good model for scattering of electrons from donor impurities. Consider a uniform 


two-dimensional density ny of fixed impurities, which are hard circles of radius a. 


(a) Show that the differential cross-section of a hard circle scattering through an angle 6 is 


do = - de” ap: 
2 2 


and calculate the total cross-section. 
Let b denote the impact parameter, which (see figure) is related to the angle 0 


between p' and p by 
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b(6) = asin be 


= acos ~. 
The differential cross-section is then given by 
. 0 
do = 2\db| = asin Phas 


Hence the total cross-section 


7 


@ 6 0 
Oro = / d@asin = =2a|—cos—| =2a. 
0 2 210 


(b) Write down the Boltzmann equation for the one-particle density f(q, p,t) of the 
Lorentz gas (including only collisions with the fixed impurities). (Ignore the electron 
spin.) 

The corresponding Boltzmann equation is 
LT a ed 
ot om 0g “Op 


[2052 IP, [-16) +10] 


= ld ol fP) -f)] = C[F@)]. 


(c) Find the eigenfunctions and eigenvalues of the collision operator. 


(d) Using the definitions F = —0U/dq, and 
nG.=[CpfG.P.9, and (9G.)= aa CpfG. P84, 9), 
show that for any function y(|p|), we have 
0 0 P > Ov 
tes noe a =F AVN. 
sn wr aa (n(Bx}) = (n{ 35) 
Using the above definitions we can write 
—(n 
dt 
do alt 
+ [ don, (A) - £6) 
0 P > 0 
--3 (lB o# (2). 
Oq m Op 
Rewriting this final expression gives the hydrodynamic equation 
0 0 Pp > oN 
ae +—-(n(2y)) =F-(n(4}). 
a aay (obi) =F (5) 
(e) Derive the conservation equation for local density p = mn(q, t), in terms of the local 


velocity 1 = (p / m). 
Using x = 1 in the above expression 


0 0 Pp 
—n+—s es =0. 
Ot aq m 
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In terms of the local density p = mn, and velocity u = (p/m), we have 


0 ace 3) =0 
are aq (Pt) =0. 


(f) Since the magnitude of particle momentum is unchanged by impurity scattering, the 


m 


Lorentz gas has an infinity of conserved quantities |p|”. This unrealistic feature is 
removed upon inclusion of particle—particle collisions. For the rest of this problem 
focus only on p*/2m as a conserved quantity. Derive the conservation equation for 


the energy density 


Nd 


(9,1) = =—(c’), where c= 


in terms of the energy flux h= p(é c?) /2, and the pressure tensor P,, = P(Ca€g)- 
With the kinetic energy y = p?/2m as a conserved quantity, the general conserva- 


tion equation reduces to 


5 (ati) (SCE) =) 


Substituting p/m =u-+¢, where (Cc) = 0, and using p= nm, 


p 


24 2 (]4 2 [2 Granw+e+20-2)] =P Fa 

lou +5 (e’) +35 5 (+ e)(u +c +2u é)) = u. 
From the definition ¢ = p(c?) /2, we have 

ole 2 | LP Gi? Pri ag Om a ery a ar |=4Fa 

Pa +e +33 5 (au + u(c?)+(éc?) +20 (é¢)}) ag U. 


Finally, by substituting h= ple c*) /2 and Pyg = P(CyCp) , we get 


OTp 5 0 [./P 5 > 0 pas 
za +e]+—-[ (5 +8) +h] + —— Pg) = EF i. 
rab ae t \2" aa, ena = oe 
(g) Starting with a one-particle density 


2; 
°(p, 4, 1) =n(q,t = 
f (gt) = n(q, t) exp Imk, TG. 


2Qamk,T(q, t)’ 


reflecting local equilibrium conditions, calculate 7, h, and P.g- Hence obtain the 
zeroth-order hydrodynamic equations. 
There are only two quantities, 1 and p*/2m, conserved in collisions. Let us start 


with the one-particle density 


2. 
— ' P : 
Gt =nG.t a qt) 
f (Pp. 9.0) =n(q ex 2mk,T(q, | 2amk,T(G, t) 


Then 
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since both are odd functions of p, while f° is an even function of p, while 
n n 
Pup = (Cap) =— (PaPg) = —6yp°mkgT = nkpTo gg. 
m m 
Substituting these expressions into the results for (c) and (d), we obtain the zeroth- 


order hydrodynamic equations 


dp 
—=0, 
Ot 

0 dp 


The above equations imply that p and € are independent of time, that is, 
p=n(q), and e=kgT(q), 


or 


O_ n(q) P 
= =~ exp sell 
2amk,T(q) 2mk,T(q) 
(h) Show that in the single collision time approximation to the collision term in the 


Boltzmann equation, the first-order solution is 


— ae p (dnp danT p oT F 
AOAD= POA) 72.( =— + 


dq. 0g | 2mkgT2 dq kgT 


The single collision time approximation is 


fay 
cifl= 
7 
The first-order solution to the Boltzmann equation 
f=f'(ts) 
is obtained from 
Ce: 
L[fya—-, 
[j=-£ 
as 
1 0 Pp a > 0 
=—-71—L[ f°] =—r 9,2. In f?+F-—inf?}. 
ae lO ed ni ae i 
Noting that 
0 p 
Inf* = Imk,T +Inn—InT —In(27mk,), 


where n and T are independent of t, we have d\n f°/dt = 0, and 


»~ { —P p [lon 10T > OT 
g=—T)F. E\aes 5 = £ = 
mk,T m |ndq T dq 2mkp,T? 0g 


p (lop 10T . p or F 
ee) ee 
m \pdq T dq 2mk,T? 0g k,T 
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(i) Show that using the first-order expression for f, we obtain 
pu=nt [F- k,TVIn (o7)| : 
Clearly [ af? A+) = f dqf? =n, and 


u,= (Pe) == f pate) 


n 


m 
Ol éinT F OT 

fer 7s np n Boy P f°. 
m m \ 04g Ogg KkpgT 2mk,T? dgg 


1 
n 
Wick’s theorem can be used to check that 


(PaPp)y = SapmkeT, 
(P°PaPg)o = (mk,T) [284 + 26.6] = 45 .g(mkgT), 


resulting in 


Rearranging these terms yields 


0 
pu, =NnT E —k,T—In on] : 
0q 


Qa 


(j) From the above equation, calculate the velocity response function Yq, = 0U,/OFg. 


The velocity response function is now calculated easily as 


ihe, 


Xap =>p om : 
B OF, p B 


(k) Calculate P,g, and h, and hence write down the first-order hydrodynamic equations. 


The first-order expressions for pressure tensor and heat flux are 


Pog =~ (Pap) =SepnksT, and 8! Pyg =0, 
m 
ef pi Pe 2Pi (4 4 by? 
an Im} (PaP = m3 (pap m (a,+b\p ) 0 : 


The latter is calculated from Wick’s theorem results 


(DiPaP’) = 46,; (ink, ry > and 


(PiPaP’P’) = (mkgT)? [8qi(4+2) +4 x 28g; +4 x 28qi] = 228 qi; 


as 


sf a ~\  22(mk,T)3 9 
ho | Gaery i ig a ag 
m Oda 2mkpT Ody 
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Substitute these expressions for P,g and h, into the equation obtained in (e) 


“| +e]+5 i (Bu? +6) — ink Tr | + 5 (inkgT) 
—|=u € “TU u € n To as (Un => 
2 aq 2 Bag | (ag 7 
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7. Thermal conductivity: consider a classical gas between two plates separated by a distance 
w. One plate at y= 0 is maintained at a temperature T,, while the other plate at y = w 
is at a different temperature T,. The gas velocity is zero, so that the initial zeroth-order 


approximation to the one-particle density is 


n(y) exp | p:p 
[2armkT(y)}” 2mkgT(y) | 


ff Ppaya= 


(a) What is the necessary relation between n(y) and T(y) to ensure that the gas velocity 
u remains zero? (Use this relation between n(y) and 7(y) in the remainder of this 
problem.) 


Since there is no external force acting on the gas between plates, the gas can 
only flow locally if there are variations in pressure. Since the local pressure is 


P(y) = n(y)kgT(y), the condition for the fluid to be stationary is 
n(y)T(y) = constant. 


(b) Using Wick’s theorem, or otherwise, show that 


(p°)’ = (PePa)? =3(mkgT), and (p*)’ = (pepaPgPp) = 15(mkgT) 


where (0° indicates local averages with the Gaussian weight f?. Use the result 


(p°\" = 105(mk,T)* in conjunction with symmetry arguments to conclude 
0 3 
(p;p') = 35(mkgT)’ . 
The Gaussian weight has a covariance (Paz). = 6,,(mk,T). Using Wick’s theorem 
gives 


2 


(v°)" = (PaPa)® = (mk gT) 8 aq = 3 (mkgT). 


Similarly 


(v*)” =(paPaPePe) = (mkgT)” (8aq+ 25ap5ag) = 15 (mkgT)’ 


The symmetry along the three directions implies 


(p2p')’ = (rp) = (p>p') = 5( ? ps)’ = ; x 105(mk,T)* = 35 (mkgT). 
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(c) The zeroth-order approximation does not lead to relaxation of temperature/density vari- 


(d 


(e 


) 


wm 


ations related as in part (a). Find a better (time-independent) approximation f/ (Dp, y), 


by linearizing the Boltzmann equation in the single collision time approximation to 


F) a.) 1_ £0 
Lift] ~ nad: fox fi fi 
ot mody TK 


where Tx is of the order of the mean time between collisions. 


Since there are only variations in y, we have 


0 , 0 ; i 3 3 
aera =) oPy a In fo = oP) 4, finn 5 InT Z In (2a7mk ,) 
m ° m * 


ot mody 


| 


2mk,T 2 
oPy [An 30,T p oT i 5 P a,T 
mL n 2T  2mkjTT| “'ml 2° 2mk,T} T 


where in the last equality we have used nT = constant to get d,n/n = —0,T/T. Hence 


the first-order result is 


™ mn Py ({ P S\ a7 
: =F) 1 >|. 
fi @.¥) =f; (@, y) | ss soo) a kt 2) T 


Use f}, along with the averages obtained in part (b), to calculate h,, the y com- 
ponent of the heat transfer vector, and hence find K, the coefficient of thermal 
conductivity. 


Since the velocity u is zero, the heat transfer vector is 


In the zeroth-order Gaussian weight all odd moments of p have zero average. The 


corrections in f}, however, give a non-zero heat transfer 


h _ i n 0,T Py P 5 ns 
ym? T \m \Qmnk,T 2)? | 


Note that we need the Gaussian averages of (P; p'\? and (Pp; p’)’. From the results of 


part (b), these averages are equal to 35(mk,T) and 5(mk,T), respectively. Hence 


A Ot 
(kg) ( 


35 5x5 5 ntgk2T 
y= —Tk5 3 
m 


— 0, T. 
2 2 2 sm ; 
The coefficient of thermal conductivity relates the heat transferred to the temperature 


gradient by h=—K VT, and hence we can identify 


_5 NT k2T 


2 m 


K 


What is the temperature profile, T(y), of the gas in steady state? 
Since 0,T is proportional to —d,h,, there will be no time variation if h, is a 


constant. But h, = —K0,T, where K, which is proportional to the product nT, is 


> 
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a constant in the situation under investigation. Hence 0,T must be constant, and 
T(y) varies linearly between the two plates. Subject to the boundary conditions of 
T(0) =T,, and T(w) = T,, this gives 


T, —T,; 
T(y) =T, + -~— 


y- 
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Solutions to selected problems from 
chapter 4 


1. Classical harmonic oscillators: consider N harmonic oscillators with coordinates and 
momenta {q;, p;}, and subject to a Hamiltonian 

N 2 29 
E mo g: 


Hq; pi}) = + 
({4:. Pi}) d i : 


(a) Calculate the entropy S, as a function of the total energy E. 
(Hint. By appropriate change of scale, the surface of constant energy can be deformed 
into a sphere. You may then ignore the difference between the surface area and 
volume for N > 1. A more elegant method is to implement this deformation through 
a canonical transformation.) 


The volume of accessible phase space for a given total energy is proportional to 


1 
X= av dae dq, ---dqy dp, dp,---dpy, 


where the integration is carried out under the condition of constant energy, 


N 2 2 2 

Pi m@ qj 
E-H({q,p)\)= 
({4;. Pid) >|3 Baar 


Note that Planck’s constant h is included as a measure of phase space volume, so as 
to make the final result dimensionless. 

The surface of constant energy is an ellipsoid in 2N dimensions, whose area is 
difficult to calculate. However, for N — oo the difference between volume and area is 
subleading in N, and we shall instead calculate the volume of the ellipsoid, replacing 
the constraint H = E by Hl < E. The ellipsoid can be distorted into a sphere by a 


canonical transformation, changing coordinates to 


Gg, =J/magq,, and pj= Bs 


The Hamiltonian in this coordinate system is 


N 
@ 
E=K ((q, P= 5 U(r +4). 
i=l 


Since the canonical transformation preserves volume in phase space (the Jacobian is 


unity), we have 


a ’ y y 7 
mS BF Ic ag 84177 84 Ot AP 
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where the integral is now over the 2N-dimensional (hyper-)sphere of radius 
R= ./2E/o. As the volume of a d-dimensional sphere of radius R is S,R4/d, we 


obtain 
aw 2m 1 (2E\" _ (2mE\" 1 
“(N—D! 2N\ho) ~ Vho ) NV 


The entropy is now given by 


27TeE 
S=k,InQwe Nkzl : 
a yin (Ee) 


(b) Calculate the energy E, and heat capacity C, as functions of temperature T, and N. 


From the expression for temperature, 


1 OS| _ Nk 
T OE rv E° 
we obtain the energy 
E= Nk,T, 
and the heat capacity 
C= Nkg. 


(c) Find the joint probability density P(p, g) for a single oscillator. Hence calculate the 
mean kinetic energy, and mean potential energy for each oscillator. 

The single-particle distribution function is calculated by summing over the undesired 

coordinates and momenta of the other N —\ particles. Keeping track of the units of 


h used to make phase space dimensionless gives 


J H<ty-1) grat dqp- + dqy dp, ---dpy r dp, dq, 


P(P1,%) dp, dq, = 


J H<n) TRADI --dqy Ap; dp2--- dpy h 
where Ey_, = E— pj/2m— mw? q;/2. Using the results from part (a), 
O(N —1, Ey_1) 
PP. 1) = aE 


N-1 
( 2 rs qN-l E ai mw 2 
hes (W-D! 2m 2 41 


h(&) rE 


p 2 5 N-1 
1 mo~ 
= w N ae qq 

27 E E 


Using the approximation (N — 1) ~ N, for N > 1, and setting E = Nk,T, we have 


: N 
Py 209 
wo N FL + ma qi 
; = 1 2m 2 
PP 9) = OF NEF Nk»T 
0) i +a a 
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Solutions to selected problems from chapter 4 


Let us denote (p,, q,) by (p,q), then 


0) w p mo’ 
Q= ex 
PSD oakyT \ QmkyT ky 


is a properly normalized product of two Gaussians. The mean kinetic energy is 
2 2 
P / P 
—)= »9g)— dqdp= : 
(| P(p. 9), dadp 
while the mean potential energy is also 


mo’ q’ mo’ q’ kpT 
( )= | ve, q) dqdp = ——. 


2 2 


2k 2K 2k aK 2K KK 


2. Quantum harmonic oscillators: consider N independent quantum oscillators subject to a 


Hamiltonian 
: 1 
KH ({n;}) = >> ho (n+ ;) : 
i=l 
where n; = 0, 1, 2,--- is the quantum occupation number for the ith oscillator. 
(a) Calculate the entropy S, as a function of the total energy E. 
(Hint. O,(E) can be regarded as the number of ways of rearranging M = >°;n;, balls, 


and N — 1 partitions along a line.) 


The total energy of the set of oscillators is 
N 
N 
E=ho (S0+ 4 ; 
i=l 


Let us set the sum over the individual quantum numbers to 


The number of configurations {n;} for a given energy (thus for a given value of M) is 
equal to the possible number of ways of distributing M energy units into N slots, or of 


partitioning M particles using N — \ walls. This argument gives the number of states as 


_ (M+N-—1)! 
~ M!(N-1)! 


> 


and a corresponding entropy 


M+N-1 M 
S=k,gnQ~kg|(M+N—1DIn Min 
e e 


(N yn(*=)]. 
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(b) Calculate the energy E, and heat capacity C, as functions of temperature T, and N. 


The temperature is calculated by 

1 as kp (M4+N-1 ke ~+%- ke E+%ho 
=> ~w = n 7 

T dEly ho M how ~£-% ho E- ho 


By inverting this equation, we get the energy 


N_ exp(hw/k,T)+1 1 1 
— 0)) = Nho + > 
2 exp(hw/k,T)-1 2 exp(hw/k,T)—1 


and a corresponding heat capacity 
<i ( hw ) exp (hw/k,T) 
ae tre [exp (hw/k,T) —1]° 


(c) Find the probability p(n) that a particular oscillator is in its nth quantum level. 
The probability that a particular oscillator is in its nth quantum level is given by 


summing the joint probability over states for all the other oscillators, that is, 
i= 2 p05 = VeE-mtiyre!  O (N-1, E-(n+ })ha) 
: YL | O(N, E) 


{nizi} 

_ [M—n)+N-2]! MI-(N-D)! 

~ (M—n)!-(N—2)! (M+N-1)! 
M(M —1)---(M—n+1)-N 


~ (M4N—1)(M4+N—2)--(M4N—n-1) 


~ N(M+N)-""'M", 
where the approximations used are of the form (I —1) * I, for I >> 1. Hence, 


( ) Pe E a —n-1 E N n 
njb= a oe A 
" ho 2 ho 2 


E N E N 
jo + 2 \ io + 2 
which using 
Lp (BA eee nho 
= a = ex — > 
Tho "\E— Xie aoe eh ee 


leads to the probability 
ia) ho 1 ho 
n) = ex n ex : 
x ke PE ET 


(d) Comment on the difference between heat capacities for classical and quantum oscil- 


lators. 
As found in part (b), 


Cig tig 
quantum B kT ih i z° 
exp kat 
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In the high-temperature limit, iw/(k,T) «1, using the approximation e* © 1+ x for 
x <1, gives 


C 


quantum 


= Nk, =C, 


classical * 


At low temperatures, the quantized nature of the energy levels of the quantum oscil- 
lators becomes noticeable. In the limit T > 0, there is an energy gap between the 
ground state and the first excited state. This results in a heat capacity that goes to 


zero exponentially, as can be seen from the limit hw/(k,T) > 1, 


hw \° ho 
C uantum — Nk exp | — < 
q eat kT 


2k ok 2k oo 2K ok 2K 


3. Relativistic particles: N indistinguishable relativistic particles move in one dimension 


subject to a Hamiltonian 


N 


H ({Pis ai}) = yy [clpi| + U(ai)]. 
i=l 
with U(g;) =0 for 0 < gq, < L, and U(q;) = co otherwise. Consider a microcanonical 
ensemble of total energy E. 


(a) Compute the contribution of the coordinates gq, to the available volume in phase space 
QO(E, LN). 

Each of N coordinates explores a length L, for an overall contribution of L™ /N!}. 

Division by N! ensures no over-counting of phase space for indistinguishable particles. 

(b 


we 


Compute the contribution of the momenta p; to 0.(E, L, N). 
(Hint. The volume of the hyper pyramid defined by ee x; < R, and x; > 0, ind 
dimensions is R4/d!.) 

The N momenta satisfy the constraint yn \p;| = E/c. For a particular choice 
of the signs of {p;}, this constraint describes the surface of a hyper pyramid in N 
dimensions. If we ignore the difference between the surface area and volume in the 


large N limit, we can calculate the volume in momentum space from the expression 


1 (/E\* 
0.20%. f=), 
P N! Cc 


The factor of 2% takes into account the two possible signs for each p;. The surface area 
of the pyramid is given by /dR4— /(d —1)!; the additional factor of Vd with respect 
to dvolume/dR is the ratio of the normal to the base to the side of the pyramid. Thus, 


given in the hint as 


the volume of a shell of energy uncertainty A,, is 
JN (E\N Ag 
(N—1)! 


QO’ = Qn 
P c c 

We can use the two expressions interchangeably, as their difference is subleading 

in N. 
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(c) Compute the entropy S(E, L, N ). 
Taking into account quantum modifications due to indistinguishability, and phase 


space measure, we have 


Q(E, L, N) = 


LLY ow. VN (E Nl Ag 
hn N! (N — 1)! 


(os c 


Ignoring subleading terms in the large N limit, the entropy is given by 


S(E, L, N) = Nkgl oe, PP 
iv i = ni —-—-— 
Be \he NN 


(d) Calculate the one-dimensional pressure P. 
From dE = TdS — PdV + wd, the pressure is given by 


os NkpT 
P=T—| =. 
OL |e y L 
(e) Obtain the heat capacities C, and Cp. 
Temperature and energy are related by 
1 os Nkg OE 
P08 \2g <B af = OE lei, ’ 


Including the work done against external pressure, and using the equation of state, 


(f) What is the probability p(p,) of finding a particle with momentum p,? 
Having fixed p, for the first particle, the remaining N — | particles are left to share 
an energy of (E —c\p,|). Since we are not interested in the coordinates, we can get 


the probability from the ratio of phase spaces for the momenta, that is, 
Q, (E—clpi|,N —1) 
0,(E.N) 


=| ree (Sy «EB 


cN clp,|\" _ cN cN|p,| 
~ -{ 1 ~ “exp . 
2E E 2E E 


Substituting E = Nk,T, we obtain the (properly normalized) Boltzmann weight 
c clpil 
= - eX] Fy 
P(Pi) IT P( kpT 


2k ok 2k 2k 2K 2k KK 


P(P}) = 


4. Hard sphere gas: consider a gas of N hard spheres in a box. A single sphere excludes 
a volume w around it, while its center of mass can explore a volume V (if the box is 
otherwise empty). There are no other interactions between the spheres, except for the 
constraints of hard-core exclusion. 
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Solutions to selected problems from chapter 4 


(a) Calculate the entropy S, as a function of the total energy E. 
(Hint. (V —aw) (V —(N —a)o) © (V— Nw/2)°.) 
The available phase space for N identical particles is given by 


1 35 35435 35 
= Saaw | Pd Pave Oy, 


where the integration is carried out under the condition 


N 


; or >- p; = 2mE. 
i=l 


N 19 
Pi 


E=KH(4qj, Pi) = mm 


i=l 
The momentum integrals are now performed as in an ideal gas, yielding 


ee (2mE)3N/2-! 
Nth3N 


. 2m'N - | dg,--- dg 
(@ =i) N Qn: 
5 ! 


The joint integral over the spatial coordinates with excluded volume constraints is 
best performed by introducing particles one at a time. The first particle can explore 


a volume V, the second V — w, the third V — 2a, etc., resulting in 
/ PG, ---PGy = VV —@)(V —20)---(V—(N— 1a). 


Using the approximation (V — aw)(V — (N — a)w) © (V — Nw/2), we obtain 


35 35 Nw\" 
[Pa--BGv~(V->) - 


Thus the entropy of the system is 


e Nw AnmEe \ >” 
S=k,zInQ * Nkgin 4 : 
N 2 3Nh2 


(b) Calculate the equation of state of this gas. 
We can obtain the equation of state by calculating the expression for the pressure 
of the gas, 
P_ os Np 
T OViny V-*’ 
which is easily rearranged to 
Now 
P (v : =) = NkpT. 
2 
Note that the joint effective excluded volume that appears in the above expressions is 
one half of the total volume excluded by N particles. 
(c) Show that the isothermal compressibility, k; = —V~' dV/dP|,, is always positive. 
The isothermal compressibility is calculated from 
1 ov Nk pT 
Kr = = > 0, 
V OP \ry P?V 


and is explicitly positive, as required by stability constraints. 
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5. Non-harmonic gas: let us re-examine the generalized ideal gas introduced in the previous 
section, using statistical mechanics rather than kinetic theory. Consider a gas of N non- 


interacting atoms in a d-dimensional box of “volume” V, with a kinetic energy 


7 s 
H=> Alpi’. 


i=1 


where p; is the momentum of the ith particle. 


(a) Calculate the classical partition function Z(N, T) at a temperature T. (You don’t have 


to keep track of numerical constants in the integration.) 


The partition function is given by 


1 eo iat 
Z(N.T.V) = rag foo f ty AG dBi d Bw exp [2X4 


i=l 
! dz qd, Is)y] 
= winaw Lf f e42"Bexp(-Ba]p))] 
Ignoring hard-core exclusion, each atom contributes a d-dimensional volume V to 


the integral over the spatial degrees of freedom, and 


yN 
Nthen 


Z(N, T, V) = [| d“pexp(—BA aly] 


Observing that the integrand depends only on the magnitude |p | = p, we can evaluate 
the integral in spherical coordinates using { d4p = S, { dpp‘', where Sz denotes 


the surface area of a unit sphere in d dimensions, as 


N 


Vv Pcie ar 
Z(N,T,V) = wind [suf dpp*' exp (—BAp' . 


Introducing the variable x = (BA)'/‘p, we have 


VN SN A —dN/s 0° a N 
Z(N,T,V) = a (5) if dxx4 texo(—»)] 


1 (/VS,\" ( A \ ON 
=C%(d,s)_(—F) ( 
( daa ( Fe) (<5) 


where C denotes the numerical value of the integral. (We assume that A and s are 
both real and positive. These conditions ensure that energy increases with increasing 


|p|.) The integral is in fact equal to 


aa 1 
C(d, s) =| dxx*—! exp(—x*°) dx = pa (<). 


and the partition function is 


= niles) (ae) [CS] 
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Solutions to selected problems from chapter 4 


(b) Calculate the pressure and the internal energy of this gas. (Note how the usual 


(c) 


equipartition theorem is modified for non-quadratic degrees of freedom.) 


To calculate the pressure and internal energy, note that the Helmholtz free energy is 


F=E-TS=-k,TInZ, 


and that 
OF . dInZ 
=-—|, while E=—- ——_|. 
OV |> op ly 
First calculating the pressure 
OF OlnZ NkpT 
P =- — = kp Ee = si 
Vv |> OV |r V 


Now calculating the internal energy: 


0 | aN | ( A )] dy * 
= n = . 
V op Ss kp_T s 3 


Note that for each degree of freedom with energy A|p;|\*, we have the average value, 


dlnZ 
E-= 


(Alp;|*) = £kgT. This evaluates to 3kgT for the three-dimensional ideal gas. 


Now consider a diatomic gas of N molecules, each with energy 


PT) 


where the superscripts refer to the two particles in the molecule. (Note that this 


” =(2)|' 


H,= A( ~ 7% 


aa +|3 


> 


unrealistic potential allows the two atoms to occupy the same point.) Calculate the 


() 4a 


expectation value ja -—4q , at temperature T. 


Now consider N diatomic molecules, with 


=(1) — 9?’ 
qi i | : 


al + 


pO] )+K 


N 
H=SH, where KH, =A( 
i=1 


The expectation value 


( 


is easily calculated by changing variables to 


4? —4| exp[-BE, 90] 
ES ee EP aD aM ep 0E%] 


=(1 
qi - qi 


(1) a2) qa2(1) aa 22 
\ APT ata? da dtp? dp 


9 +9 
2 


x= Gg —G, and y= 


as (note that the Jacobian of the transformation is unity) 
(\a- i’) = J dtxd¢y- |x|'-exp[—BK|x|"] 
J d¢x%d¢y-exp[—BK|x|'] 
J d¢x-|x|'-exp[—BK|x|"] 
= ff d¢x-exp [—BK|x|"] 
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Further simplifying the algebra by introducing the variable Z = (BK)"/'x, leads to 


(a -4')= (BK)-"" f d4z-|z|'-exp[—|z|"] _@ kpyT 
fd¢z-exp[—|z|"] t K 


Here we have assumed that the volume is large enough, so that the range of integration 


over the relative coordinate can be extended from 0 to ~. 


Alternatively, note that for the degree of freedom % = q) — q, the energy is K|x|'. 


Thus, from part (b) we know that 
4 d k,T 
(K |x|‘) as i 
t K 


’ 


that is, 
d kpT 
zit) /|70)_ 2z@yt\_ & SB 
(5) =([a -9 Jo 2. . 


And yet another way of calculating the expectation value is from 


> =(1) 4 | _ 1dmZ Nd kT 
ge age ge ae 


i=1 


(note that the relevant part of Z is calculated in part (d) below). 
(d 


we 


Calculate the heat capacity ratio y = Cp/Cy, for the above diatomic gas. 


For the ideal gas, the internal energy depends only on temperature T. The gas 


in part (c) is ideal in the sense that there are no molecule—-molecule interactions. 


Therefore, 
gpd) PY) ae 
Vv Vv 
and 
Pe eee ear el 
Since PV = Nk,T, 
Cp = a + Nkp. 
dT 


We now calculate the partition function 


1 FH pfs) adatl adele 
Z= ax | Taal a4 449,” a°B.? exp —BYH; 
: i=l i 


1 N 
~ inant? 


where 


> > > > > Ss = S es = a. 
cas [0G ag a5 a5 exp[—B- (|p| +4 [pl +K [a -4°)] 


2 
> > > > t > > S 
= [/ d4g 444 exp (—8K a -4| )}-L/ d4B exp (64 |p| )] 


265 


Solutions to selected problems from chapter 4 


Introducing the variables, x, y, and Z, as in part (c), 
yn 00 N © 2N 
Z« Ti [iexy*" | git exp(—c)de| : if p*' exp(—BAp’) ap] 
! 0 0 


Low o'e( 2) Loner) 


a“ (BK) 4" (BA) NA! : 


Now we can calculate the internal energy as 
dnZ d 
apts 


From this result, the heat capacities are obtained as 


(E)= 


2d i <2 
Nk gT + Nig? = dNtgt (742), 
AY Ss 


con El ap | ong (224241 
Pe Ele Oily Nee ee , 
c= =) =ane,(=++ 
UE ee Se ee 


resulting in the ratio 
Cp _ 2d/st+d/t+1 _ st 
Cy 2d/st+d/t ~— —— d(2t+s) 


y= 
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6. Surfactant adsorption: a dilute solution of surfactants can be regarded as an ideal three- 
dimensional gas. As surfactant molecules can reduce their energy by contact with air, a 
fraction of them migrate to the surface where they can be treated as a two-dimensional 
ideal gas. Surfactants are similarly adsorbed by other porous media such as polymers and 
gels with an affinity for them. 


(a) Consider an ideal gas of classical particles of mass m in d dimensions, moving in a 
uniform attractive potential of strength ¢,. By calculating the partition function, or 
otherwise, show that the chemical potential at a temperature T, and particle density 
Ng, 1s given by 

bg = —Eqtk,T In [n A(T)“] , where A(T)= es 

/2amk,T 


The partition function of a d-dimensional ideal gas is given by 


1 Na 5 tes Na P 
Z1= xan | J Ue qd" p,exp )—B Niet (22) 


Na 
= i Va e PNaea 
Ny! \ AA 


where 


(b) 


(c) 
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The chemical potential is calculated from the Helmholtz free energy as 


— A 
ODN bow BON: lie 
Va 
= =e, +ksTIn( 4), 


If a surfactant lowers its energy by €) in moving from the solution to the surface, 
calculate the concentration of floating surfactants as a function of the solution con- 
centration n (=n), at a temperature T. 

The density of particles can also be calculated from the grand canonical partition 
function, which for particles in a d-dimensional space is 


co 


E(u, Vz,T)= >> Z(Ng, Va, T) PX" 


st (Vy V, 
= 3 wil (53) e PNaed eBNak — exp (4) 4 . 


The average number of particles absorbed in the space is 


ee a Va -ePlu-ea) | — Va -eflu-ea). 
B op Bou |\a Xr 


We are interested in the coexistence of surfactants between a d =3 dimensional 


solution, and its d = 2 dimensional surface. Dividing the expressions for (N;) and 
(N,), and taking into account &) = &; — 5, gives 


(Ni) _ AA 


eet, ePeo 


= > 


(Ns) V 
which implies that 


Ny = (No) = ndeP*, 
A 

Gels are formed by cross-linking linear polymers. It has been suggested that the 
porous gel should be regarded as fractal, and the surfactants adsorbed on its surface 
treated as a gas in d,-dimensional space, with a non-integer d,. Can this assertion 
be tested by comparing the relative adsorption of surfactants to a gel, and to the 
individual polymers (presumably one-dimensional) before cross-linking, as a function 
of temperature? 

Using the result found in part (b), but regarding the gel as a d,-dimensional 


container, the adsorbed particle density is 


(7201) = nd4r exp [Ble3 ~~ Eve) 3 


Thus by studying the adsorption of particles as a function of temperature one can 
determine the fractal dimensionality, d , of the surface. The largest contribution comes 
from the difference in energies. If this leading part is accurately determined, there is 
a subleading dependence via \*~4, which depends on d fe 


2K OK OK 2K OK OK OK OK 
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Solutions to selected problems from 
chapter 5 


1. Debye-Hiickel theory and ring diagrams: the virial expansion gives the gas pressure as 
an analytic expansion in the density n = N/V. Long-range interactions can result in non- 
analytic corrections to the ideal gas equation of state. A classic example is the Coulomb 
interaction in plasmas, whose treatment by Debye—Hiickel theory is equivalent to summing 
all the ring diagrams in a cumulant expansion. 


For simplicity, consider a gas of N electrons moving in a uniform background of positive 
charge density Ne/V to ensure overall charge neutrality. The Coulomb interaction takes 


the form 


2 
2s 4 : 5 e 
Ug => VGi-4). with V(q)= 4 


ig} mq 


The constant c results from the background and ensures that the first-order correction 
vanishes, that is, f d°qV(q) =0. 


(a) Show that the Fourier transform of V(q) takes the form 


e’/w fora4¢0 
(9 for @=0— 


The Fourier transform of V(q) is singular at the origin, and can be defined explicitly 


as 
P(@) = lim / BPGV(G) eb i-24, 
The result at @ = 0 follows immediately from the definition of c. For w #0, 
= e sees e nce 
P() = lim / dg (~~ c) el 4-4 < im [ ag ( — ) ee 4-20 
e>0 47q 20 47q 


T oo 2 ; 
= lim [2a sin oo | ¢ dq ( od ) eiegcos | 
a+ 0 0 41g 


e ie elwq—eg _ @-iwq-eq 
2 Jo 


; dq 
10 


2 2 2 

ki e 1 mn 1 hi e e 
= lim = lim | ———- ] = —.. 
e>02in \iw—e iwte e>0 \ w2+ €2 w? 
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(b) In the cumulant expansion for (uy we shall retain only the diagrams forming a ring, 


which are proportional to 


ag Bg 7 A Ly - is * 
Ryp= a sal “a VG — 42) VG — 93) °° VGe — H1)- 


Use properties of Fourier transforms to show that 


1 Po ~ 
R,=—— | —~— Va)’. 
6 yel (27)3 
; 0 : : : : 
In the cumulant expansion for (lars we retain only the diagrams forming a ring. 
The contribution of these diagrams to the partition function is 


PPR PH 


Rp= V vo yn G2) V (Go — 43) Ve - 41) 


1 . = . . . > . oN 
= a of BPX, APH, ++ AP Xp_ PGV(H)V (Hp) ++ V(Xp_1)V (-E5] > 
i=1 


where we introduced the new set of variables {X; = 4; — 941}, for i= 1,2,---,€-1. 


Note that since the integrand is independent of q,, 


1 


Re= ye-l 


é-1 
[-f Ba PR MEINE”? (= i). 
i=1 


Using the inverse Fourier transform 


1 


VG) = Gas | PHP, 


the integral becomes 


1 ~ 2 (> \n-i1-5199(7, \ aid 
R= pom l oe] PX, --- PX, V(@,)et V(@, e122 


e-1 
--- V(@,) exp (“x @,: is) Po,---Ba,. 


k=l 
Since 


ag 
(2m)° 


e i@4 = 5°(0), 


we have 


1 oY as eS 3> 37 
Rp= erceal f (in Hi, — 8) 7G) do, 


resulting finally in 
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c) Show that the number of ring graphs generated in (2/¢ : is 
g graphs g ole 


M! (€-1)!_ (€—1)! 
S, — x ~ 
(N—0)! 9 2 


N°. 


The number of ring graphs generated in (i ' is given by the product of the number 
of ways to choose € particles out of a total of N, 


M! 
(N—®)!” 


multiplied by the number of ways to arrange the £ particles in a ring, 


£! 

Yh 
The numerator is the number of ways of distributing the € labels on the € points 
of the ring. This over-counts by the number of equivalent arrangements that appear 
in the denominator. The factor of 1/2 comes from the equivalence of clockwise and 
counter-clockwise arrangements (reflection), and there are £ equivalent choices for 


the starting point of the ring (rotations). Hence 


N! e N! (€—1)! 
x = x 
(N—®! 2€ (N—O! 2 


S,= 


For N > £, we can approximate N(N —1)---(N—£€+1) © N*%, and 


(€—1)! 


N. 
2 


Another way to justify this result is by induction: a ring of length €+ 1 can be created 
from a ring of £ links by inserting an additional point in between any of the existing € 
nodes. Hence S,,, = S, x (N—€—1) x £, leading to the above result, when starting 
with S, = N(N —1)/2. 


(d) Show that the contribution of the ring diagrams can be summed as 


In Zyings = =InZ)+ eae 


where k = ,/ Be?N/V is the inverse Debye screening length. 
(Hint. Use In(1 +x) = — 2, (—x)'/6.) 


The contribution of the ring diagrams is summed as 


¢ 
In Z, Zags = 12+ “?) SR, 


(—B)'(e-1)!_, 1p BS 
=InZ Nt 
" oth “a2 vel Qn 


oe) 2 oo 
= InZy+ . [ —_— sy : ( EN iw) 


t=2 


Vio)’ 
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V 2 4rwdw 21 / BNe?\‘ 
=InZ)t+ | 
9" 24 mp Bel a) 
V p& 4710” dw [ BNe? BNe? 
=InZ | In(1 ; 
pear 2Jo (27)3 EE n( = Vo )| 


where we have used In(1+ x) = — 7, (—x)‘/€. Finally, substituting « = \/ Be?N/V 


leads to 
iInZ 1 elf eee ee (“)’ 1 ia 
NZ,,,o¢ = In n : 
ae oO" 25 (m3 0) w 


(e) The integral in the previous part can be simplified by changing variables to x = k/w, 


and performing integration by parts. Show that the final result is 


yee 
rings — 11 0 lon ** 


Changing variables to x = k/w, and integrating the integrand by parts, gives 


[ode |(<) =m (1+5)| =e f° “ [x* —In(1+x°)] 


Kp? dx 2x 2x? re dx TK? 
= | 2x => = 5 
3 Jo x3 1+x2 3 Jo 14x? 3 


In Z, 


resulting in 
3 


VK V 
In Z...,. = In Z) + —~- — = InZ, + —k’. 
ee ey Pe ae ae Bl 


rings 


(f) Calculate the correction to pressure from the above ring diagrams. 


The correction to the ideal gas pressure due to the Debye—Hiickel approximation 


.) 


is 


dln Zrings 
Peer) = 


ov 

0 (VK k,T , 
=P,+k,? —(— y— 

aV \120) |e 240 


kT ( eN me 
=P Sie (a) 
Note that the correction to the ideal gas behavior is non-analytic, and cannot be 
expressed by a virial series. This is due to the long-range nature of the Coulomb 
interaction. 
(g) We can introduce an effective potential V(g—q’) between two particles by integrating 
over the coordinates of all the other particles. This is equivalent to an expectation 


value that can be calculated perturbatively in a cumulant expansion. If we include 


only the loopless diagrams (the analog of the rings) between the particles, we have 


a ae a ee 
WG-4) =VG-4) +L CBN) f St SAV Gav -&)-- 
t=1 


VQe-q)- 
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Show that this sum leads to the screened Coulomb interaction V(q) = 
e* exp(—k|q|)/(4771q|)- 
Introducing the effective potential V(q—4q'), and summing over the loopless dia- 


grams, gives 


e 
Va 4) =VG—-3)+ Lam) | SE. vg ayaa) 


VQe-q) 


> > dq > > > > 
=VG-4)—BN | Bv@-ayvq 4) 


aq, ag 


+(BN)? | are 


= Vv(q- WV(a - D)V(Q-q)--- 


Using the changes of notation 


H=q M=q, B= MEH, oo HA, 


Vip =V(X,—-X>), and n=N/V, 
we can write 


V2=Vin- Bn | PX5V3V 39 + (Bn) / Px; X4V 13V34Vao — 


at 
: 


Using the inverse Fourier transform (as in part (a)), and the notation x. {= 
yd Px Be ao ~i(813-013+%32'@32) G33 > 
Vio =Vio — Bn | (ms 6 V (G13) V(@5q) E18 O18 83232! W135 day +++ 
7 


and employing the delta function, as in part (a) 


Generalizing this result and dropping the subscript such that X = X1, 


7= Yat Gor / [ra] oF 3G), 


Finally, including the Fourier transform of the direct potential (first term), gives 


ad er a? ao (= l)fe ; al ixwcos@ 
=> | one Bn)! To irc 
(-1)%e? Ponce 
= dw (“)" / 1X@ COS d (7) 
‘, y 7a . , e cos 


£=0 


={" ton ee 1! é 
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Setting y= w/k gives 
= 1 i) e elxky 2 ev ixky | 


Vise d 
29) 2n ixey y+1” 


Intergrating in the complex plane, via the residue theorem, gives 


_ e eok eoke ee kt 
Vo= + ‘T= ; 


4m? \ 2x 2x 4ax 
Recalling our original notation, x = |q—q'| = |q|, we obtain the screened Coulomb 
potential 
2 «lal 
= ee 
VQ= 7-5 
4m |q| 
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2. Virial coefficients: consider a gas of particles in d-dimensional space interacting through 


a pairwise central potential, V(r), where 


+oo for0<r<a, 
Vir)=4-e fora<r<b, 


lo for b<r<o. 


(a) Calculate the second virial coefficient B,(T), and comment on its high- and low- 
temperature behaviors. 


The second virial coefficient is obtained from 
1 d 
B= =) d° ry, {exp[—BV("12)] — 1}, 
where ry = |F, —7)|, as 


1 a b 7 
ha lf d’na(-1)+ | d‘r,5 (e? -1] 
1 


= —5 (Vala)(—1) + [Va(b) — Vala)]-[exp(Be) — 1], 
where 
i Qt? 
GO a aga 


is the volume of a d-dimensional sphere of radius r. Thus, 


1 1 
B(T) = 5 V,(b) — 5 exp(Be) (V(b) — V,(a)]. 
For high temperatures exp(Be) © 1+ Be, and 


F v,(0)— Vula)]. 


BT) ~ 5V,(a) 
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(b) 


(c) 


At the highest temperatures, Be « 1, the hard-core part of the potential is dominant, 


and 
1 
B,(T) © 5 Vala). 


For low temperatures B > 1, the attractive component takes over, and 
1 


By = —5 {Vi(a)(-1) + [Vu(b) — Vi(a)]-[exp(Be) — 1} 


‘ -; [V,(b) — V,(a)]exp(Be), 


resulting in B, <0. 


Calculate the first correction to isothermal compressibility 


1 av | 
Kp =-sS 
V oP ie 
The isothermal compressibility is defined by 
1 ov 
LS ap. 
V OP iry 
From the expansion 
PN 
—_=_+_B, 
lat Vow 
for constant temperature and particle number, we get 
: dP 7 dV —2B ve dV. 
7 a yao 
Thus 
Ov _ 1 1 _ Vv? 1 
OP |py  -KgT N/V2+2B,N2/V3—— NkgT \14+2B,N/V)’ 
and 


Vv 1 Vv N 
Kr = ( x 1—2B, ) : 
NkpT \1+2B,N/V Nk,T Vv 


In the high-temperature limit, reorganize the equation of state into the van der Waals 
form, and identify the van der Waals parameters. 
Including the correction introduced by the second virial coefficient, the equation 


of state becomes 


PV N 
=1+—B,(T). 
NkpT Foy at) 


Using the expression for B, in the high-temperature limit, 


PV 
NkyT 


14 3 tvy(a)— BelVa(b)— Vila) 


and 
2 


P+ saAlV) —V,(a)|= bet (1 + aula) : 
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Using the variable n = N/V, and noting that for low concentrations 


1+ 5 Vala) rw (1 = *V4(a)) =V (v- * ys) 


the equation of state becomes 


2¢ N 
(P+ -_ [V,(b) — vol) (v = + ¥a(a)) = Nk,T. 
This can be recast in the usual van der Waals form 
(P — an’) -(V — Nb) = Nk,T, 
with 
€ 1 
a= [Vi(b)-—Vi(a)], and b= 5 Vala). 


(d) For b= a (a hard sphere), and d = 1, calculate the third virial coefficient B;(T). 
By definition, the third virial coefficient is 


1 i ; 1 
B= —3 f atratr fff -1), 


where, for a hard-core gas 


72) j= —1 forO<r<a, 


f(r) = exp (- ET 


0 fora<r<oo 
In one dimension, the only contributions come from 0 <r, and r' <a, where 
f(r) = f(r’) = -1. Using the notations |x| =r, |y| =r’ (i.e, —a <x, and y <a), 
1 4 Y 1 16 > 
By=-> | dx [ dy: f(x— =<// —1)=--=(2a) =a’, 
: 3 = —a - fl ») 3 ee, ) 3 3 ( ) 


where the relevant integration area is plotted below. 


ok ok 2k 2k 2K 2k KK 
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3. Dieterici’s equation: a gas obeys Dieterici’s equation of state: 


a 
P(v—b) =kp,T exp a 
B 


where v= V/N. 


(a) Find the ratio Pu/k,T at the critical point. 
The critical point is the point of inflection, described by 


oP | P| 
ov T..N 


=0, and 
OV |r oN 


pressure P 


The first derivative of P is 


0 | kpT a KkpT a a 1 
= exp = exp 
dv Lv—b k,Tv v—b kpTv] \kpTv? v—b 


oP 
dv 


T.,N 
a 1 
=P f .—__.—.- __ 5 
kpTv? v—b 

while a second derivative gives 

0 a 1 
= P 

dv kpTv= v—b 


_ OP (a 1 \_»f_24 1 
~ du \kgTv2  v—b kT (v—b)? )° 


#P 


Therefore v,.. and T, are determined by 
2a 1 


a 1 
anaeaet 2. ad. 2 2. Gg, 
kpT.v2 v.—b kpT.vi (vu. —b)? 


with the solutions 
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resulting in the ratio 


while for some actual gases 


Pv. P.v, 
= 0.230, and = 0.291. 
kp T, water kp T, argon 


(b) Calculate the isothermal compressibility k, for v= v, as a function of T — T.. 


The isothermal compressibility is defined by 


and from part (a), given by 


oP 
ov 


a 1 
T..N kpTv? v—b 


Expanding this expression, at v = v,, in terms of t=k,T —k,T. (for T > T.), yields 


oP 
Ov 


es a 1\  Pe4bt OP, 
rw \(a/4b+1)4R bb) ba kg” 
and thus 


kpT, 1 be? 
Kr = — é 
T 2P.t  2kp(T—T.) 


Note that expanding any analytic equation of state will yield the same simple pole for 
the divergence of the compressibility. 
(c) On the critical isotherm expand the pressure to the lowest non-zero order in (v—v,). 


Perform a Taylor series expansion along the critical isotherm T = T., as 


1 oP 
3! dv? 


ve #P 
Med OT ue 


oP 


P(v, T.) = P.+ 
ov 


(v—v,)? + 


TeV 


(v 


TeVe Tes Ve 


The first two terms are zero at the critical point, and 


®P|  __, 4 (_2a rl 
dv3 lee “du \kpT.w (v—b)? 


Pp 6a 2 
7 kpT.vs (uv, —b)3 


P. 


c 


~ 9p3 


(=u). 
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Substituting this into the Taylor expansion for P(v, T.) results in 


which is equivalent to 


2k 2K 2k ok 2K 2k ok 2K 


4. Two-dimensional Coulomb gas: consider a classical mixture of N positive and N negative 


charged particles in a two-dimensional box of area A = L x L. The Hamiltonian is 


H= JS Ge In |G — 4; > 


i<j 


t 


where c; =+cy fori=1,---,N, and c; = —cy fori= N+1,--- ,2N, denote the charges 
of the particles; {a} and {Bi} their coordinates and momenta, respectively. 


(a) Note that in the interaction term each pair appears only once, and that there is no 
self-interaction i = j7. How many pairs have repulsive interactions, and how many 
have attractive interactions? 

There are N positively charged particles, and N negatively charged particles. 


Hence there are N-N = N°? pairs of opposite charges, and n, = N°. For like 


attractive 


charges, we can choose pairs from the N particles of positive charge, or from the N 


particles with negative charges. Hence the number of pairs of like pairs is 


N N! 
Nrepulsive =2x =2*x = N(N 1). 


2 21(N — 2)! 


(b) Write down the expression for the partition function Z(N, T, A) in terms of integrals 
over {a} and {pi}. Perform the integrals over the momenta, and rewrite the contri- 
bution of the coordinates as a product involving powers of {ai}. using the identity 

In x 


e =X. 


The partition function is 


i<j 


Z(N, T, A) = ann [Tesch pe = +8 oe nial 


= EE / i d *g, exp [BIn|q; — qj (, 


where X=h/,/27mk,T. Further simplifying the expression for the partition function 


Oe wal Tle ‘ie qh", 
i<j 
Inx 


where we have used the fact that e"* = x. 
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(c) Although it is not possible to perform the integrals over {a} exactly, the dependence 
of Z on A can be obtained by the simple rescaling of coordinates, g;’ = q;/L. Use the 
results in parts (a) and (b) to show that Z x A2N-BcN/2., 

The only length scale appearing in the problem is set by the system size L. Rescaling 
the expression using q;' = q,/L then yields 


1 2N a 2N 
_ an Bejcj|7 1 __ 2 | Bee 
2(N.7. A) = Sareyys | Ea) Nd; q;'| J. 
Note that there are N* terms for which the interaction is attractive (Bc.c; = —Bc3), 
and N(N — 1) terms for which the interaction is repulsive (Bec; = Bp). Thus 
- 1 2N 2N 
— 74N . 7 BeaMN-1) , 7 —BcRN? 25 7 21 > 1 Bejc; 
Z(N, T, A) = L*N . LP% ioe rae f Tea 'T Geet 


i=1 i<j 
= LAN-BN6 ZN, 7 A L2= D« A2N-BGN/2 


since A= L’. 


(d) Calculate the two-dimensional pressure of this gas, and comment on its behavior at 


Nar; 


high and low temperatures. 


The pressure is then calculated from 


1 dlnZ| 
B dA ee 


=P" in (4-22, ) 
aA 


a 2Nk,T Ne? 
= kT (2N— BejN/2) — In = —# = 


At high temperatures, 


2Nk,T 
P = 
A 


’ 


which is the ideal gas behavior for 2N particles. The pressure becomes negative at 
temperatures below 
C= Bs 
© 4k,’ 
which is unphysical, indicating the collapse of the particles due to their attractions. 
(e) The unphysical behavior at low temperatures is avoided by adding a hard core that 
prevents the coordinates of any two particles from coming closer than a distance a. 
The appearance of two length scales, a and L, makes the scaling analysis of part (c) 
questionable. By examining the partition function for NV = 1, obtain an estimate for the 
temperature 7. at which the short distance scale a becomes important in calculating 
the partition function, invalidating the result of the previous part. What are the phases 
of this system at low and high temperatures? 
A complete collapse of the system (to a single point) can be avoided by adding 
a hard-core repulsion that prevents any two particles from coming closer than a 


distance a. The partition function for two particles (i.e., N = 1) is now given by 


1 3 SoS ia se qeee 
ZN =1,T,A)= 5; f BG, dG: G1 — Gl P%. 
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To evaluate this integral, first change to center of mass and relative coordinates 
pe 1/7 = 
Q= > (q+), 
q=U1—-: 


Integrating over the center of mass gives 


Af o~ -o2. 207A pt ‘aes 
Z(N=1,T,A)= f @§q ed ~ — | dq-q'-6% 


27d @-P3 | 2A 12-84 — @2-P4 
~ AA 2— Bco | ~ dA 2—Bea 


If 2— Bc), <0, as L> &, 


2A a2 
At 2— Bes 
is controlled by the short distance cutoff a; while if 2— Be > 0, the integral is 
controlled by the system size L, as assumed in part (c). Hence the critical temperature 
can be estimated by Bc, = 2, giving 
2 
C 
(fen 
2kp 
which is larger than T° by a factor of 2. Thus the unphysical collapse at low tem- 
peratures is pre-empted at the higher temperature where the hard cores become 
important. The high-temperature phase (T > T.) is a dissociated plasma; while the 
low-temperature phase is a gas of paired dipoles. 


2k ok 2k ok 2K 2k ok 2K 


5. Exact solutions for a one-dimensional gas: in statistical mechanics, there are very few 
systems of interacting particles that can be solved exactly. Such exact solutions are very 
important as they provide a check for the reliability of various approximations. A one- 
dimensional gas with short-range interactions is one such solvable case. 


(a) Show that for a potential with a hard core that screens the interactions from further 


neighbors, the Hamiltonian for N particles can be written as 
Np WN 
H= 5 +L VG; -%-1)- 
ix 2 i=2 
The (indistinguishable) particles are labeled with coordinates {x;} such that 


O<x, <x) <-:-<x,<L, 


where L is the length of the box confining the particles. 

Each particle i interacts only with adjacent particles i— 1 and i+1, as the hard 
cores from these nearest neighbors screen the interactions with any other particle. 
Thus we need only consider nearest-neighbor interactions, and, including the kinetic 


energies, the Hamiltonian is given by 


N pp WN 
H= Vit LV xi-1), for O<x, <x) <-+-xy <L. 
i=1 i=2 
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(b) Write the expression for the partition function Z(T,N,L). Change variables to 
6, =X, 6) =X, —X,, +++, Oy =Xy —Xy_y, and carefully indicate the allowed ranges 
of integration and the constraints. 


The partition function is 


dx, exp | Ye Va;- “0| 


i=2 


1 iE L L 
Z(T.N,L) = + | dx, | dxy-- | 
xy x 


*N-1 


love) 0° 2, 
D; 
: _ —o0 PN SER e 4 z 


1 rk L L 
=— dx, | dxy-- | 
wh 7. ae | 


N-1 


dx, exp | YL V(x; - “0| , 
i=? 


where X= h/,/27mk,T. (Note that there is no N! factor, as the ordering of the 


particles is specified.) Introducing a new set of variables 
6) =X, 8,=%,—-X, +++ 6, =Xy—xXy_1, 
or equivalently 
N 
x, =6;, x» =6,4+6,, ++ xy=)>>5;, 
i=l 
the integration becomes 


1 L L-8, L—(8, +83) 
Z(7.N,L)= sq f 46, [ 46, [ d6,--- [ 


This integration can also be expressed as 


L-DN 8; 
TT dBy en PE VO), 


i=2 


1 4 n 
Z(F.N,L) = 55 [| d5, d5, - --d8y | exp |-2xre0| 
with the constraint 


0<) 6,<L. 


Me 


i 


This constraint can be put into the equation explicitly with the use of the step function 


0 for x<0O 
O(x) = . 
1 forx>0 


as 


1 oo 0° oo N N 
Z(T, N,L) = ax | dé, | dd, | ddy exp |-2xre0| ro) (.- ¥a) 
0 0 0 i=2 i=l 
(c) Consider the Gibbs partition function obtained from the Laplace transformation 


Z(T,N, P) = | ” aL exp(—BPL)Z(T, N, L), 
0 
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(d) 


and by extremizing the integrand find the standard formula for P in the canonical 
ensemble. 


The Gibbs partition function is 
2(T, N, P) = | dL exp(—BPL)Z(T, N, L). 
0 


The saddle point is obtained by extremizing the integrand with respect to L, 


r) | 
— exp(—BPL)Z(T,N,L)| =0, 
éL TN 
which implies that 
d | ainZ| 
PPS zn) 4. = Peer—) 
OL T,N T,N 


From thermodynamics, for a one-dimensional gas we have 


OF 
dF = —SdT — PdL, => P=—- aL 


T,N 


Further noting that 


again results in 


Peanonical = kpT 


T,N 


Change variables from L to 8y,,; =L—>°%, 6;, and find the expression for 2(T, N, P) 
as a product over one-dimensional integrals over each 6,. 


The expression for the partition function given above is 


Z0NL)=— f a5, dd, fo 26, x0] -25:7(6) (1-08). 


i=2 


The Laplace transform of this equation is 


2(T, N, P) = xf dLexp(—BPL) [ dé, i dB. [ dd, 


-exp [23:70] (2) (. -¥8) 


i=2 


=yae fl 8, [~ d5s--- f 26, <x0] BS: ¥0) 


I 


1 00 0° N 
= one, d6,--- f s6yex0| Sara) +806] 


II 
is} 
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Since the integrals for different 6;'s are equivalent, we obtain 


N-1 
2(T, N, P) = {f° ddexp[— pve) +P5)]| 


GFF 
This expression can also be obtained directly, without use of the step function as 


follows. 


1 L L-6, L—(8,+62) L-yN 4: 
2(T,N, Pas f 46, | a6, | ad, [ d5, 
co N 
| dL exp [erp (x ve) 
0 i=2 
1 L L—-6; L-DN 8; 00 
=n | 46, [ d6,--- [ dn f ow, a(1- 3) 


xo -60[3>9,+ (4-3-2) |-2(3v@)) | 


Change variables to 5y,,; =L— ><, 6,, and note that each of the 8’s indicates the 


distance between neighboring particles. The size of the gas L has been extended to 
any value, hence each 6 can be varied independently from 0 to oo. Thus the Gibbs 


partition function is 


2(7,N,P)=, [ 45, [- 8, f° d3y [ d8 41 


-exp er & 3) - (> Vv(6; ] 
i=l i=2 
1 eo N-1 6 
8 (/ enn BP5)) [ d8,exp(—BP5;) 


-[ d8y41 exp(-BP BN 41) 


N-1 
= GFF {i eh Bve@)+Po))} 


(e) At a fixed pressure P, find expressions for the mean length L(T, N, P), and the density 
n= N/L(T, N, P) (involving ratios of integrals that should be easy to interpret). 


The mean length is 


L(T, N, P) = —k,T =e In Z(T, N, P) 
2 i. 48-8-exp[—-BV(3) — BP8| 
7 ppt \™ ™ Jo, 45-exp[—BV(5) — BP] * 


and the density n is given by 
N 2k pT . dé-8-exp[—B (V(8) — Pd 
| 22D cy — Lo" 98:3 ex[=B (V6) = P9)] 


~ L(T,N,P) P Jo 45- exp[—B (V(6) — PS)] 
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(f) 


Note that for an ideal gas V;, (6) =0, and 


N+1)k,T 
L, (T, N, P) = ise a 
8. P 
leading to 
N P 
nD)ig = N+1 ket 


Since the expression for n(T, P) in part (e) is continuous and non-singular for any 
choice of potential, there is in fact no condensation transition for the one-dimensional 
gas. By contrast, the approximate van der Waals equation (or the mean-field treatment) 
incorrectly predicts such a transition. 

For a hard-sphere gas, with minimum separation a between particles, calculate the 
equation of state P(T, n). Compare the excluded volume factor with the approximate 
result obtained in earlier problems, and also obtain the general virial coefficient B,(T ). 


For a hard-sphere gas 
6,>a, for i=2,3,-:-,N, 


the Gibbs partition function is 


N-1 
2(.N, P)= Ep mi | [ dd exp (—BV(5) — pP5)] 
N-1 
dé Pd 
=m || Ben-79)| 
1 1 \Nt 7 
=a (=) exp(—BPa)*™'. 
From the partition function, we can calculate the mean length 
Ol 1)k,T 
be=er Of) ae +(N—la, 
ai P 


which after rearrangement yields 


(N+1) n+1/L 


BP= = & (n+1/I)(1+(n—1/L)a+(n—1/L)*a? +--+). 


L—-(N-l1)a 1-—(n—1/L)a 
For N> 1, n> 1/L, and 


BPX n(ltnatn’a?+---)=n+an?+a7n+---, 
which gives the virial coefficients 


B,(T) =a 


The value of B; = a> agrees with the result obtained in an earlier problem. Also note 
that the exact “excluded volume” is (N —1)a, as opposed to the estimate of Na/2 
used in deriving the van der Waals equation. 
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chapter 6 


1. One-dimensional chain: a chain of N +1 particles of mass m is connected by N massless 
springs of spring constant K and relaxed length a. The first and last particles are held 
fixed at the equilibrium separation of Na. Let us denote the longitudinal displacements 
of the particles from their equilibrium positions by {u;}, with uy = uy = 0 since the end 


particles are fixed. The Hamiltonian governing {u;}, and the conjugate momenta {p;}, is 


ae Pe Sass = 5 (u Yis4 a) +4 | : 


(a) Using the appropriate (sine) Fourier transforms, find the normal modes {i,}, and the 
corresponding frequencies {w,}. 


From the Hamiltonian 


ei 
H= » ra Sas} F ¥ (u;— Hot > 


the classical equations of motion are obtained as 


Pu, 
m ae = —K(u,;—u,_,)— K(u; —uj41) = K(uj_ — 2u; + uj 41), 
for j=1,2,---,N—1, and with uy = uy =0. In a normal mode, the particles 


oscillate in phase. The usual procedure is to obtain the modes, and corresponding 
frequencies, by diagonalizing the matrix of coefficients coupling the displacements 
on the right-hand side of the equation of motion. For any linear system, we have 

2u,/dt? = K;ju;, 
a ed of the difference i—j. This is a consequence of translational symmetry, 


and we must diagonalize K;;. In the above example, K;; is only 


and allows us to diagonalize the matrix using Fourier modes. Due to the boundary 
conditions in this case, the sine transformation is appropriate, and the motion of the 


jth particle in a normal mode is given by 


ign (i) = & e' sin (K(n)- 3). 


The origin of time is arbitrary, and to ensure that uy =0, we must set 


k(n), for n=1,2,++-,N=1. 
N 
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Larger values of n give wavevectors that are simply shifted by a multiple of 7, and 
hence coincide with one of the above normal modes. The number of normal modes 
thus equals the number of original displacement variables, as required. Furthermore, 


the amplitudes are chosen such that the normal modes are also orthonormal, that is, 
N-1 
> x(n) 62) . ecm) 62) — On 
j=l 


By substituting the normal modes into the equations of motion we obtain the dispersion 
relation 


o> = 205 [1 — COs (*)| = w; sin (=) ‘ 
N 2N 


where wy) = /K/m. 


The potential energy for each normal mode is given by 


Noting that 
N N 
,/nr/(, 1 1 | [= : ]] N 
—l(i-=]JJ=-= 1 —(2i--1 =, 
doe E ( ;)| > +cos y (2i—1) 5 
we have 


9 (NT 
Urn) = 2K sin (Cw) . 


(b 


= 


Express the Hamiltonian in terms of the amplitudes of normal modes {i,}, and 
evaluate the classical partition function. (You may integrate the {u;} from —oo to 
+00.) 


Before evaluating the classical partition function, let’s evaluate the potential energy 


by first expanding the displacement using the basis of normal modes, as 


N-1 
ujp= x ay* ite (J). 


n=1 
The expression for the total potential energy is 


N-1 ~ 


U= > Cr = i 4) = ; > zs a, [itx¢ny (J) _ nny - 1] 
i=l i= 


n=1 
Since 


N-1 N-1 


» in (A) . Um) G — 1) =5 5m > {—cos [k(n)(2j — 1)] +cosk(n)} 
j=l 


j=l 


= 6, Cosk(n), 
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the total potential energy has the equivalent forms 


K N N-1 
v= zy =K> a, (1—cosk(n)), 
i=l 


n=1 
nv 
_ 2s Gin) Un = = 2K 3 Din) sin (=). 


The next step is to change the coordinates of phase space from u, to a,,. The Jacobian 
associated with this change of variables is unity, and the classical partition function 


is now obtained from 


Sas al. da, -- ie day_ ie] - 2BK Ya sin? Galt 


n=1 


where A =h/,/27mmk,T corresponds to the contribution to the partition function 


from each momentum coordinate. Performing the Gaussian integrals, we obtain 


-ao ll ie da, exp | — 2BKa? sin’ (=). 


(c) First evaluate lil”), and use the result to calculate (u?). Plot the resulting squared 


displacement of each particle as a function of its equilibrium position. 


The average squared amplitude of each normal mode is 


(a2) = J da, (a2) exp [—2BKa? sin? (32 
um f® da, exp [—28Ka? sin? (27)] 


= [48K sin’ (Gy = ae aay 


The variation of the displacement is then given by 


N-1 N-1 
Wl=([E at 0] )- (a) in) 
n=1 n=1 


N-1 N-1 2 (nw 
= > 5° (atsin® (22) = Aer > SE) 
N N 2KN *= sin’ (22) 


The evaluation of the above sum is considerably simplified by considering the 


combination 


kpT N=! 2.cos [2 j] cos[ #7 (j+1)] cos [ 27 (j 


(uj41) + (uj_1)— (uj) = 2KN » 1 —cos (22) 


__ kg 8! 2e08(22)[1—cos(*E)] _ ke 


= 3KN 1 —cos (27) ~ KN’ 
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(d) 


Nkpl/K 
~o ft 
oO 
a 
5 
z F 
ol ra 
g free ad 
a ; 
& 
ctl 
fixed end 
0 
0 N/2 
Position j 


N- 
n=1 


where we have used ~‘7| cos(an/N) = —1. It is easy to check that subject to the 


boundary conditions of (us) = (ui) = 0, the solution to the above recursion relation is 
( A _ kT i(N — j) 
uj) = ew 
How are the results modified if only the first particle is fixed (uy = 0), while the 
other end is free (uy 40)? (Note that this is a much simpler problem as the partition 
function can be evaluated by changing variables to the N — 1 spring extensions.) 
When the last particle is free, the overall potential energy is the sum of the 
contributions of each spring, that is, U = K ee (u;—u way /2. Thus each extension 
can be treated independently, and we introduce a new set of independent variables 
Au; = Uj; —Uj_y. (In the previous case, where the two ends are fixed, these variables 
were not independent.) The partition function can be calculated separately for each 


spring as 


es fia “a = x y 
= ywot wf Uy_1 ©XP| — > Uj — Uj_y 
ANA! Jaco 00 2k—T 57 ye 


1 oe % oe Qak,T \ 9? 
ad en ee =( VK ) ¢ 


For each spring extension, we have 


The displacement 


i=l 


is a sum of independent random variables, leading to the variance 


(uj)= S as) = ¥ (Au; = 7 
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The results for displacements of open and closed chains are compared in the above 
figure. 


2k 2k 2k 2K 2k KK 


2. Black hole thermodynamics: according to Bekenstein and Hawking, the entropy of a black 


hole is proportional to its area A, and given by 


S= kpc 
4Gh 


(a) Calculate the escape velocity at a radius R from a mass M using classical mechanics. 


(b 


we 


Find the relationship between the radius and mass of a black hole by setting this 
escape velocity to the speed of light c. (Relativistic calculations do not modify this 
result, which was originally obtained by Laplace.) 

The classical escape velocity is obtained by equating the gravitational energy and 


the kinetic energy on the surface, as 


leading to 


r 


For a mass larger than given by this ratio (i.e., M > c?R/2G), nothing will escape 
from distances closer than R. 

Does entropy increase or decrease when two black holes collapse into one? What is 
the entropy change for the Universe (in equivalent number of bits of information) 
when two solar mass black holes (M, * 2 x 10°? kg) coalesce? 


When two black holes of mass M collapse into one, the entropy change is 


3 3 
ane kpc 


4Gh ~ 4Gh 


_ tke 26 : (22 * | 87Gk,M? F 
~~ GR Ce Ce ~ ch a 


Thus the merging of black holes increases the entropy of the universe. 


AS = §,—258, = 


(A) —2A,) 4ar (R3 — 2R}) 


Consider the coalescence of two solar mass black holes. The entropy change is 
87Gk,M2 

~ ch 

_ 87-6.7 x 107! (N- m? kg) - 1.38 x 10-3(JK~') - (2 x 10°)? kg? 

“ 3 x 108(ms~!)- 1.05 x 10-4(J-s) 


AS 


=~ 3x 10°(J/K). 
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In units of bits, the information lost is 


_ ASIn2 


N,= =15x 10". 
1 ke x 


The internal energy of the black hole is given by the Einstein relation, E = Mc’. Find 


(c 


YS 


the temperature of the black hole in terms of its mass. 
Using the thermodynamic definition of temperature 4 = ®, and the Einstein rela- 


T OE? 
tion E = Mc’, 


1 1 0 | kp? (2G..\*|  8akpG Ac 1 
- sen( u) |=" vo = F . 


T  c0aM|4Gh ce he ~ 8ak,G M- 


(d 


wm 


A “black hole” actually emits thermal radiation due to pair creation processes on its 
event horizon. Find the rate of energy loss due to such radiation. 

The (quantum) vacuum undergoes fluctuations in which particle—anti-particle pairs 
are constantly created and destroyed. Near the boundary of a black hole, sometimes 
one member of a pair falls into the black hole while the other escapes. This is a hand- 
waving explanation for the emission of radiation from black holes. The decrease in 
energy E of a black body of area A at temperature T is given by the Stefan—Boltzmann 


law, 


4 ky 
——2=-oT’, where g= : 
A ot 60A3c? 


Find the amount of time it takes an isolated black hole to evaporate. How long is this 


(e 


wm 


time for a black hole of solar mass? 
Using the result in part (d) we can calculate the time it takes a black hole to 


evaporate. For a black hole 


2G. \*°  167G? Ad 1 
A=ter =4e( it) =" a, Pee. ad P=, 
Cc? ct 87k,G M 


Hence 


4 
eyes ms l6omG* 2 he 1 
dt 603 c? ct 87k,G M 


which implies that 


we dM _ Ach 
dt —-15360G2 


This can be solved to give 
M(t) = (M3 — 301)". 


The mass goes to zero, and the black hole evaporates after a time 


M3 5120G?M,° 
p= = 9 22x 10", 
3b ict 
which is considerably longer than the current age of the Universe (approximately 
x10'%s). 


(f) 


(g) 


(a) 
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What is the mass of a black hole that is in thermal equilibrium with the current cosmic 
background radiation at T = 2.7K? 


The temperature and mass of a black hole are related by M = hc? /(87k,GT). For 
a black hole in thermal equilibrium with the current cosmic background radiation at 
T =2.7K, 


ve 1.05 x 10-**(J-s)(3 x 108)?(ms7!)3 
8ar- 1.38 x 10-23(JK-!) 6.7 x 10-"1(N-m2kg~2) -2.7K 


~ 4.5 x 10” kg. 


Consider a spherical volume of space of radius R. According to the recently formulated 
Holographic Principle there is a maximum to the amount of entropy that this volume 
of space can have, independent of its contents! What is this maximal entropy? 

The mass inside the spherical volume of radius R must be less than the mass that 
would make a black hole that fills this volume. Bring in additional mass (from infinity) 
inside the volume, so as to make a volume-filling black hole. Clearly the entropy of the 
system will increase in the process, and the final entropy, which is the entropy of the 


black hole, is larger than the initial entropy in the volume, leading to the inequality 


where A = 4mR? is the area enclosing the volume. The surprising observation is that 
the upper bound on the entropy is proportional to area, whereas for any system of 
particles we expect the entropy to be proportional to N. This should remain valid 
even at very high temperatures when interactions are unimportant. The “holographic 
principle” is an allusion to the observation that it appears as if the degrees of freedom 
are living on the surface of the system, rather than its volume. It was formulated in the 
context of string theory, which attempts to construct a consistent theory of quantum 
gravity, which replaces particles as degrees of freedom, with strings. 


2k 2k 2k ok kK 


3. Quantum harmonic oscillator: consider a single harmonic oscillator with the Hamiltonian 


2 22 
d 
Gat fs. Sie pe. 
2m 2 i dq 


Find the partition function Z, at a temperature T, and calculate the energy (#1). 


The partition function Z, at a temperature T, is given by 


Z2="ps) eo". 


n 


As the energy levels for a harmonic oscillator are given by 


1 
=h =- > 
En o(n+5) 
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the partition function is 


1 
Z=) exp [Bho (n+ | =e Pho/2 1 .3Bhw/2 4 |, 


1 1 
~~ eBho/2 _ e@-Bho/2 ~ 2 sinh (Bhaw/2) 


The expectation value of the energy is 


w) = dInZ__ (hw) cosh(Bha/2) (hw 1 
a ap =( 2 ) sinh(Bhiw/2) =( 2 ) aa 


(b) Write down the formal expression for the canonical density matrix p in terms of the 


eigenstates ({|n)}), and energy levels ({e,}) of H. 


Using the formal representation of the energy eigenstates, the density matrix p is 


p= 2sinn ( *) (Civee[- pho (n+; 5) |‘) 


In the coordinate representation, the eigenfunctions are in fact given by 


inlay = (2) Aen (-E). 


VJ 2"n! 2 
where 
m@ 
f= 
with 


1,(6) = (1) expt@)(Z) expt-€) 


2, 00 
_ Sle / (—2iu)" exp(—u? + 2iéu)du. 
T —oo 
For example, 


A(éy=1, and Ag) = ~ exp) exp(—€”) = 2£, 


é 


result in the eigenstates 


Ola) = (2) "exo (-SP), 


(lq) = (— on eee g-exp (— nea’). 


Using the above expressions, the matrix elements are obtained as 


Hole) =< Calin") (a!loln) (lg) ax LtexPLc Bho (n+ s)]- (a'ln) dna) 
(4 Vola) = 3 a) alin) (ay a nD] 


= 2sinh (5 ). Lex - pho (n+ a (q'|n) (nlq) . 


and 
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(c) Show that for a general operator A(x), 
0 0A 0A 
— exp[A(x)] 4 — exp[A(x)], unless A, —|]=0, 
Ox Ox Ox 


while in all cases 


“ tr {exp [A(x)]} = tr “ exp [aco : 


By definition 


‘il 
A n 
= —A 5 
: Xu n! 
and 
de4 _ y 1 0A" 
Ox cer nl Ox ~ 


But for a product of n operators, 
0 0A A 
—(A-A-++A) = —-As AFA: — Af FA Aree, 
Ox Ox Ox 


The a can be moved through the A’s surrounding it only if [A, al = 0, in which 


case 


0A 0A yy deA oA A 
—=n—A" , and —=—e’. 
Ox Ox Ox Ox 


However, as we can always reorder operators inside a trace, that is, tr(BC) = 
tr(CB), 


and the identity 


o tr(e*) =tr (= ) 
Ox Ox 
0A 


can always be satisfied, independent of any constraint on [A, aa), 


(d 


we 


Note that the partition function calculated in part (a) does not depend on the mass m, 


that is, 0Z/dm = 0. Use this information, along with the result in part (c), to show 


that 
P a mo’ q° 
2m] 2 | 


The expectation values of the kinetic and potential energy are given by 


2 2 2,2 2,2 
Po =tr La : and ieee =tr ae p}. 
2m 2m 2 2 


293 


294 


Solutions to selected problems from chapter 6 


Noting that the expression for the partition function derived in part (a) is independent 


of mass, we know that 0Z/dm = 0. Starting with Z = tr Cael } and differentiating 


OZ 0 0 
= pH) _ eee 
am om i C ) ” E ae me 


where we have used the result in part (c). Differentiating the Hamiltonian, we find 


that 


29 
Foe] +tr |-e—t ev =0. 
m 


Equivalently, 


2 29 
tr Pe BH =tr =, e BH > 
2m 2, 


which shows that the expectation values of kinetic and potential energies are equal. 


(e) Using the results in parts (d) and (a), or otherwise, calculate (7). How are the results in 
Problem | modified at low temperatures by inclusion of quantum mechanical effects? 


In part (a) it was found that (FC) = (Rhw/2) (tanh(Bhw/2))~'. Note that (FC) = 
(p?/2m)+(mw*q?/2), and that in part (d) it was determined that the contribution 


from the kinetic and potential energy terms are equal. Hence, 
1 
(mw q’ /2) = 5 (hw/2) (tanh(Bhw/2))'. 


Solving for (q°), 


(2) = — (tanh(Bhiw/2)) = 5 a 


2mw mo 


coth(Bhw/2). 


While the classical result (7) = k,T/m@* vanishes as T — 0, the quantum result 
saturates at T =0 to a constant value of (q’) = h/(2mw). The amplitudes of the 
displacement curves in Problem 1 are affected by exactly the same saturation factors. 


(f) In a coordinate representation, calculate (q'|p|q) in the high-temperature limit. One 


approach is to use the result 


exp(BA) exp(BB) = exp[B(A + B) + B’[A, B]/2+ 0(6")]. 


Using the general operator identity 


exp(BA) exp(BB) = exp[B(A + B) + B’[A, B]/2+ O(B")], 


the Boltzmann operator can be decomposed in the high-temperature limit into those 


for kinetic and potential energy; to the lowest order as 


P m w ¢ 


exp (-0 , 


) ns exp(—Bp?/2m) -exp(—Bmu?4?/2). 
2m 
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The first term is the Boltzmann operator for an ideal gas. The second term contains 


an operator diagonalized by \q). The density matrix element 
(q'|pla) = (q'lexp(—Bp’ /2m) exp(—Bmw* q’ /2)|q) 
= | 4p'(a'lexp(—Bp? /2m)|p') (p'|exp(—Bmw*g?/2)|q) 
= | 4p'(a'Ip’)(p'\a) exp(—Bp?/2m) exp(—Bq?mw?/2). 
Using the free particle basis (q'|p') = mae", 


1 eee ee 
(q'|plq) = a | ape” )/h Bp” /2m Bq? ma? /2 


2 
— 9 Be me?/2 1 dai /1B 1 /2m j il 2m on? 
e == | p’ exp (ny am DRY BY?) |%P\ age | 


where we completed the square. Hence 


1 _gc2 mex? mk,T ; 
(q'|pla) = —e #4"? /2armkgT exp | -—4—(q—q') |. 
27h 2h 


The proper normalization in the high-temperature limit is 


Z= [ dq(gle#" Pm .c-Pme?e Iq) 


= f dg f ap (gle®” "|p" (pile Pm"? q) 
k,T 


—Bp'? /2m..—Bmw q2 
= {dg f dp|(alp)P emer Breit? = 


Hence the properly normalized matrix element in the high-temperature limit is 


; ma mw, mk pT 5 
i = ex exp | — a : 
(4'|P14) iim 720 Ink, F r/ wt) P| aH (9-7) 
(g) At low temperatures, p is dominated by low energy states. Use the ground state wave 
function to evaluate the limiting behavior of (q'|p|q) as T > 0. 
In the low-temperature limit, we retain only the first terms in the summation 


- |O)e~Bho/2 (0| Ae | 1)e73ho/2 (]| or 
PiimtT0 ~ e—Bhw/2 4 @—3Bho/2 : 


Retaining only the term for the ground state in the numerator, but evaluating the 


geometric series in the denominator, 


(q'|P14)iimr-+0 © (4/10) (O|q)e~P**?? « (ePRO/? _ e-Phw/2) 


Using the expression for (q|0) given in part (b), 


(W'|P\9)iim ro © ~ exp Es (¢ +4)| (1-27 Phe) | 
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4. Relativistic Coulomb gas: consider a quantum system of N positive, and N negative 


charged relativistic particles in box of volume V = L?. The Hamiltonian is 


= ee cil + ee — =F, 


i<j 


where e; = +e) fori=1,---,N, and e; = —ey fori=N-+1,--- ,2N, denote the charges 
of the particles; {F} and {pi} their coordinates and momenta, respectively. While this is 


too complicated a system to solve, we can nonetheless obtain some exact results. 


(a) Write down the Schrédinger equation for the eigenvalues e,,(L), and (in coordinate 
space) eigenfunctions w,({7,}). State the constraints imposed on WF) if the par- 
ticles are bosons or fermions. 

In the coordinate representation p, is replaced by —ihV,, leading to the Schrédinger 


equation 


2N 
[Sa ihV;, +45 l7,— ela | n({7;}) = 8,(L)¥, n({7})- 


i<j 


There are N identical particles of charge +e), and N identical particles of charge 
—€y. We can examine the effect of permutation operators P, and P_ on these two 


sets. The symmetry constraints can be written compactly as 
2 P. ~ 
PP ow A) = nl, ({7;}). 


where n = +1 for bosons, n = —1 for fermions, and (—1)? denotes the parity of the 
permutation. Note that there is no constraint associated with exchange of particles 
with opposite charge. 

(b) By a change of scale 7,’ =7,/L, show that the eigenvalues satisfy a scaling relation 
€,(L) = €,(1)/L. 


After the change of scale Fr,’ =7,/L (and corresponding change in the derivative 
V,’ = LY,), the above Schrédinger equation becomes 


Sota] E) --«((Z)) 


The coordinates in the above equation are confined to a box of unit size. We can 


vw 


ih 


ont 


Pl 


regard it as the Schrédinger equation in such a box, with wave functions WV; ({7, “}) = 
7 w, ({7; '/L}). The corresponding eigenvalues are &,(1) = Le,(L) (obtained after 
multiplying both sides of the above equation by L). We thus obtain the scaling relation 


e,(L) = 2), 


(c 


YS 


Using the formal expression for the partition function Z(N, V, 7), in terms of the 
eigenvalues {¢,(L)}, show that Z does not depend on T and V separately, but only 
on a specific scaling combination of them. 


(d) 


(e) 
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The formal expression for the partition function is 


20N.v. 1) =u (= esw(—") 
-De0(-fr)) 


where we have used the scaling form of the energy levels. Clearly, in the above sum 


T and L always occur in the combination TL. Since V = L?, the appropriate scaling 


variable is VT?, and 
Z(N, V, T) = 2(N, VT?). 


Relate the energy E, and pressure P, of the gas to variations of the partition function. 
Prove the exact result E = 3PV. 


The average energy in the canonical ensemble is given by 


dInZ 
0(VT3) 


dInZ 


dinZ ,OInZ 
~ a(VT3) 


R=--— = Yamal 
ag BOT 


=k,T°(3VT*) = 3k,VT* 
The free energy is F = —kgT \nZ, and its variations are dF = —SdT —P dV + pdN. 


Hence the gas pressure is given by 


oF alnZ , anZ 
— =, — sk, ——. 
av a(VT?) 


The ratio of the above expressions gives the exact identity E = 3PV. 

The Coulomb interaction between charges in d-dimensional space falls off with sep- 
aration as e;e;/ 7-7, \°°. (In d = 2 there is a logarithmic interaction.) In what 
dimension d can you construct an exact relation between E and P for non-relativistic 
particles (kinetic energy )~; p7/2m)? What is the corresponding exact relation between 
energy and pressure? 

The above exact result is a consequence of the simple scaling law relating the 
energy eigenvalues &,(L) to the system size. We could obtain the scaling form in 
part (b) since the kinetic and potential energies scaled in the same way. The kinetic 
energy for non-relativistic particles )\; p;/2m = — \;h°V?/2m scales as 1/L? under 
the change of scale r,'=7T,/L, while the interaction energy pee e,e;/ |7, - al ind 
space dimensions scales as 1/L*~?. The two forms will scale the same way in d = 4 


dimensions, leading to 


En(1) 


e,(L) = 


The partition function now has the scaling form 
ZN VEL D=2 LY) H=2(8, V9). 


Following steps in the previous part, we obtain the exact relationship E = 2PV. 
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(f) Why are the above “exact” scaling laws not expected to hold in dense (liquid or solid) 
Coulomb mixtures? 
The scaling results were obtained based on the assumption of the existence of a 
single scaling length L, relevant to the statistical mechanics of the problem. This is 
a good approximation in a gas phase. In a dense (liquid or solid) phase, the short- 
range repulsion between particles is expected to be important, and the particle size 
a is another relevant length scale that will enter in the solution to the Schrédinger 
equation, and invalidate the scaling results. 


2k ok 2k ok 2K 2k ok 2k 


5. The virial theorem is a consequence of the invariance of the phase space for a system of 
N (classical or quantum) particles under canonical transformations, such as a change of 
scale. In the following, consider N particles with coordinates {ai}, and conjugate momenta 
{p,} (with i= 1,---,N), and subject to a Hamiltonian 1 ({p,}, {4;}). 


(a) Classical version: write down the expression for the classical partition function, 

Z = Z[H]. Show that it is invariant under the rescaling g, > Aq,, Py > P,/A of 

a pair of conjugate variables, that is, Z[A(] is independent of A, where AL, is the 
Hamiltonian obtained after the above rescaling. 

The classical partition function is obtained by appropriate integrations over phase 


space as 


1 = 
= rel (Ne’n0°a) ae 


The rescaled Hamiltonian H, = KH (p,/d, {Pizy} AG,» {Gizi}) leads to a rescaled 


partition function 


i pH 
Z[941= sos | (Ie'ne’s)< ide 


which reduces to 


Z19 = aw [ (Aa°ph) (Aah) (n eta) c PH — 7, 
under the change of variables q,' = q,, P\' = P,/A. 

(b) Quantum mechanical version: write down the expression for the quantum partition 
function. Show that it is also invariant under the rescalings g,; > Aq), Py > D/A, 
where p; and q; are now quantum mechanical operators. (Hint. Start with the time- 
independent Schrédinger equation.) 


Using the energy basis 
Z=tr (er) =F ee, 
n 


where E, are the energy eigenstates of the system, obtained from the Schrédinger 


equation 


H ({p:} > {a}) ln) = E,, ln) > 


(d) 
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where |,,) are the eigenstates. After the rescaling transformation, the corresponding 


equation is 


HK (P,/A, {Biz} Aq, {4:2:}) |v”) = EY [ye). 


In the coordinate representation, the momentum operator is p,; = —ihd/dq,, and 
therefore ({4:}) =o ({Aq;}) is a solution of the rescaled equation with eigenvalue 
E™ = E,. Since the eigenenergies are invariant under the transformation, so is the 
partition function, which is simply the sum of corresponding exponentials. 


Now assume a Hamiltonian of the form 
> 2 
H=r + ({G}). 
7 2m 
Use the result that Z[A(,] is independent of A to prove the virial relation 


Or) aaa 
—_]=\7—-')> 
m 0q, 


where the brackets denote thermal averages. 


Differentiating the free energy with respect to \ at = 1, we obtain 


—— f a| \_ p? WV 
=a) ee a 


B2\ fav 
—_—/=\55- 4 )- 
m 0q) 


The above relation is sometimes used to estimate the mass of distant galaxies. The 


dlnZ, 


0 
OX 


that is 


stars on the outer boundary of the G-8.333 galaxy have been measured to move with 
velocity v¥ 200kms~!. Give a numerical estimate of the ratio of the G-8.333’s mass 
to its size. 
The virial relation applied to a gravitational system gives 
GMm 
(mv?) = (2) 
R 
Assuming that the kinetic and potential energies of the stars in the galaxy have reached 


some form of equilibrium gives 


2K ok ok KK KK 
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1. Identical particle pair: let Z,(m) denote the partition function for a single quantum particle 
of mass m in a volume V. 


(a) Calculate the partition function of two such particles, if they are bosons, and also if 
they are (spinless) fermions. 
A two-particle wave function is constructed from one-particle states k,, and k,. 
Depending on the statistics of the two particles, we have 


Bosons: 


eas _ {ela + Had ean 2 for ky # ky 
13 2/RB ; 
{k1) 12) for ky =k, 


Fermions: 


sbi p= [e Ika) — Ma) Ha) V2 fr ky 


jn state for k, =k, 


For the bose system, the partition function is given by 


Zz = te (oP!) = YF (ky, bole PM [ky ko) 


ky .ko 
_ (ky | (ko + (hol Kil pir |i) |ko) + [ho 1k) pH 
= 2 a e 5} + AUP |k)|k) 


= >> exp E oe (ki + a] +) exp (- ore) 
mt k 


koko 2m 


1 h i a 1 BRR? 
~ > © exp] FF +48) +5 Deww(- ). 


ky.ko a 


and thus 


2t=3[eim+2(%)] 


For the fermi system, 


Z =tr (ce F*) = > (highole P[k. to) 
ky ko 
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_ (kil Chal = (hol kal pir Ui) Ika) = ko) a) 
ky >k2 J2 J2 


1 he 1 Ak 


kiko k a 


and thus 


25 = 3 [aim —2,(3)] 


Note that classical Boltzmann particles have a partition function 
: 1 
classical 2 
Z; = sive) . 


(b) Use the classical approximation Z,(m) = V/A? with A = h/./27mk,T. Calculate the 
corrections to the energy E, and the heat capacity C, due to bose or fermi statistics. 


If the system is non-degenerate, the correction term is much smaller than the 


classical term, and 


In Z¥ = In {[Z,(m)* + Z,(m/2)] /2} 

Z,(m/2) 
Z,(m)? |—in2 
Z,(m/2) _ 
Z,(m) 


=21nZ,(m)-+In{ 1 


= 2InZ,(m) + In2. 


Using 
h 


J2amk,T 


Z,(m) = where A(m)= 


ee 
A(m)3” 


we can write 


cg ¢ AGH [ % : A(m)3 
In ZF In Zslassical + (m) (m) =In Zeassical + 2-3/2 (m) ; 
7 V A(m/2) Vv 
h3 1} B3/? 
Aln ZF = 42°39? —______ = 42°35? _____ 
a Bie Vi2amk,T 3? Viommy 32 
Thus the energy differences are 
+ 0 3 h} B3/? 3 7a 
AE =~ 9g 21 =F 5578 Vommpe — FR eT ( v 
resulting in heat capacity differences of 
OAE 3 hk, 3 
AC; = —| = = k 
ae ar 27/2 V(2amk,T)3/2 q2 8 ( 7) 


This approximation holds only when the thermal volume is much smaller than the 


volume of the gas where the ratio constitutes a small correction. 
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(c) At what temperature does the approximation used above break down? 
The approximation is invalid if the correction terms are comparable to the first term. 
This occurs when the thermal wavelength becomes comparable to the size of the box, 
that is, for 


2k 2k aK 2K KK 


2. Generalized ideal gas: consider a gas of non-interacting identical (spinless) quantum 
particles with an energy spectrum ¢ = |p/f|*, contained in a box of “volume” V in d 
dimensions. 


(a) Calculate the grand potential §, =—k,T In Q,, and the density n = N/V, at a chemical 


potential jz. Express your answers in terms of s, d, and f(z), where z = e*", and 


00 dxx”-! 


eA 2 
n(z) = ron zlet—1 


(Hint. Use integration by parts on the expression for In Q,,.) 


The grand partition function is given by 


Fermions: 
O; = 3 PEN 3 e BLy ey — I] > eBlH—ev)ty I] [1 + Fler) | 
N=0 {ny} v ny,=0 v 
Bosons: 
O, = e ePEN Se BE vmey = TT Seber = TY — Plea] ; 
N=0 {ny} vy {ny} ve 


Hence we obtain 
InQ, =—n>-In[1- neh e)) 


where n = +1 for bosons, and n = —1 for fermions. 


Changing the summation into an integration in d dimensions yields 


V VS, 7 
x = [ain = eat = cael | dk, 


where 
A142 
S.=——. 
4 (d/2—1)! 
Then 
VSq d-1 —é 
INQ, =—n7-37 | k dk In[1 — eB] 


=-7 ul [ee tax In[1— nze**" J, 


(b) 
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where 


Introducing a new variable 


x\is 1 (/x\"! dx 
x=Bk, > k=(—=)}) , and dk=-|{— — 
Ss 


results in 


VSa ae 
"Qn 


ng,=-7 lag "In (1— nze7 *) 


Integrating by parts, 


VS —d/s x VS —d/s d/s 
InQ,= d aS dx xs ua = a B x i : 
1 Qn4 d_ l1—nze* (27)4 d zle*— 9 
Finally, 
VSa g—aisp( 4 7 
InQ, = (m4 per = +1 *fajset (z), 
where 


xr! 
RO= yf Oey 


Using similar notation, the total particle number is obtained as 


VS, per d/s-1 

=-7 dxx“/*~ In(1 — ynze~* 

aaa" (27)" s Tae ( ) 
VS, Bes xa/s-l ex VS, pes xd/s-1 

> d f  erera d & / a ae 
Qz7r)4 s 1—ynze (27)4 5 zte n 


and thus 


N Sy 


n= = Sent (2) 2,0. 


Find the ratio PV/E, and compare it to the classical result obtained previously. 


The gas pressure is given by 


VA k d/s+1 d 
PV =—k,TInQ, = Sa_ (ket) r( 


QnA F + 1) * fajsri()- 


Note that since InQ, « BW, 


E Sin d\nQ, a ring ay PV Ss 
=-—-—Iin =e OO n 2 —> = — 
ap", s Bp s ° 0 Ed 


which is the same result obtained classically. 
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(c) 


(d) 


For fermions, calculate the dependence of E/N, and P, on the density n = N/V, at 
zero temperature. (Hint. f,,(z) > (Inz)"/m! as z > ov.) 


For fermions at low T 


1 (Be no 


OE Ep), = Fin (Z) © ad 


eBle-er) + ] ni(n) ” 
resulting in 
d/s+1 d/s+1 d/s 
wy VSa : PV & VSa ep ; ne Sa er 
(Q7)4 d (27)4 5s (27) 5s 


Hence, we obtain 
d/s+1 
Eh ea 
N n (27)¢ d 


d/s+1 
PX ey IST og sath 


XX —e, xn’ 
F 
d 


For bosons, find the dimension d,(s), below which there is no Bose condensation. Is 
there condensation for s = 2 at d= 2? 

To see if Bose-Einstein condensation occurs, check whether a density n can be 
found such that z= Zax = 1. Since fajs(2) is a monotonic function of z forO<z <1, 
the maximum value for the right-hand side of the equation for n = N/V, given in part 
(a) is 

Sa 
Q2m)4s 


If this value is larger than n, we can always find z <1 that satisfies the above 


(kent (< ) sac. 


equation. If this value is smaller than n, then the remaining portion of the particles 
should condense into the ground state. Thus the question is whether fas) diverges 
at z= 1, where 


x /s-1 


Pee Cane oa N= man [axe 


The integrand may diverge near x = 0; the contribution for x ~ 0 is 


[ou 


which converges for d/s—2>-—1, or d>-s. Therefore, Bose-Einstein conden- 


x@/s-1 


= [aval 


sation occurs for d > s. For a two-dimensional gas, d = s = 2, the integral diverges 
logarithmically, and hence Bose-Einstein condensation does not occur. 


2k ok 2k oko 2k ok 2K 


3. Pauli paramagnetism: calculate the contribution of electron spin to its magnetic suscep- 


tibility as follows. Consider non-interacting electrons, each subject to a Hamiltonian 


where fy = eh/2mc, and the eigenvalues of o - B are +B. 


(The orbital effect, p > p— eA, has been ignored.) 
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(a) Calculate the grand potential G_ = —k,T In Q_, at a chemical potential p. 


The energy of the electron gas is given by 


E= per ee n;)s 
Pp 


where ns (= 0 or 1) denotes the number of particles having + spins and momentum 


2 2 
= P P 
E, (nin, )= (2, - m8) m+ (FE )n 


2 
_,\ P = 
= (nj +n; oe — (ny — 1, )MoB. 


p, and 


The grand partition function of the system is 


Po N=, (nf +n7z) 
= ¥ exp(—BuN ) x exp[—BE,(n;.,)] 
N=0 {at np) 


= exp[Bu (ni +n,) — BE, (n*,n,)] 


{nt Np } 


1, & aofole-ne- Es (oone- Ei 


Pp {nb np} 


2: 2. 
-1fseoe(e-vr-£)]} bomele (ome £)] 
= Qy (M+ MB) - Qo (HM — Mo B), 


where 


OvH) = [1 |! +0[p (.-£)]]. 


Thus 


In Q = In{Qo(u+ MoB)} + In { Qo (Hu — HoB)}- 


Each contribution is given by 


P 


In Qy(u) = Din (1 +exp[ 6 PI)= aa | ap in ce) 


Pp 


V 4am 2 
= ss | og | dxvxin(l+ ze) *), where z=e?, 


and integrating by parts yields 


Qamk,T \*” V 2 
In Qu) = V( —- i 5 f ax- aI eal = a fsale). 
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(b 


wm 


(d) 


The total grand free energy is obtained from 
“a = BpoB - —BpuoB 
In Q(u) = rr [fs (ze ) + fs. (ze )] > 
as 
Vv = BuoB = —BuoB 
G=—k,TInQ(u) = kT [Fejo (ze”"°”) + Foje (ze ne 


Calculate the densities n, = N,/V, and n_ = N_/V, of electrons pointing parallel 
and anti-parallel to the field. 


The number densities of electrons with up or down spins are given by 


Vo 4 
mQ,= pir (arn) > 
where we used 

0 2 
adn (2) = fn )- 
iz 


The total number of electrons is the sum of these, that is, 


4 inet — = 
N= N, +N_= yb Falco") + frjo(ze no) 


Obtain the expression for the magnetization M = jy(N, — N_), and expand the result 
for small B. 


The magnetization is related to the difference between numbers of spin-up and 


spin-down electrons as 


Vv 
M = bo(Ny—N_) = Hos [faa (ce) — aja (ce). 


Expanding the results for small B gives 


0 
fap (eho?) & frp [z (1+ Buy B)] © NECA) #2: BHoB= fap (z), 


which results in 


2m, V 


Vv = 2 
M= Ho 43 2BMoB)- fijal2) kT BP Sin®)- 
Sketch the zero-field susceptibility y(T) = 0M/0B|,_), and indicate its behavior at 


low and high temperatures. 


The magnetic susceptibility is 


dM| ys V 


OB iy bet 2 Fil), 


X 
with z given by 


Vow 
N= 2G BEVACOE 
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In the low-temperature limit (Inz = Bu — 00), 


iT oo n—1 ws 1 In(z) 1 nm 
RO l Pia: Taf a = 
T(n) Jo Ite™® 7.) Tn) Jo nI(n) 
Vv 4(Inz)3? 3N ia 
FP lca aie a — Inz= VT 3 ; 
BB 3,/a 8V 
_ 4uv (ee) - wv (3N\'? _ 4ampiVv ae 
x TatkyT® \ 8V ~ hte \av) ~~ We mv) ° 
The ratio of the last two expressions gives 
X|  _ Ho fin _ 3mo 1 _ 3m5 13m 
Niro kal fan 2kpT In) 2kgT Ber 2kgTr 


In the high-temperature limit (z > 0), 


= z i n—1,-x __ 
f,(2) note dxx"e* =z, 


z70 
and thus 
2 Oy N N PY 
N 0 =u, => 28 Ma. > 0, 
p0 3 2V 2V \2amk,T 
which is consistent with B + 0. Using this result, 
2uoV _ _ Neo 
gy -Z= —. 
kpTM kpT 
The result 
(<) — Ho 
N T> 0 k,T 
is known as the Curie susceptibility. 
A x/ jig 2 
WNpg? ~ Wk aT 
ve 3/2kpT ¢ 


ea a sae iia Vale catntata | 


0 > 
3/2kpT F WkpT 
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(e) Estimate the magnitude of y/N for a typical metal at room temperature. 


Since Trsom K Tp © 104K, we can take the low T limit for x (see (d)), and 


room 


xX 3m _ 3x O3x10-™) 


= 294x10-4IT?, 
N 2kpTp 2x 1.38x 10-3 i 


where we used 


eh = gri-l 
My = —— £9.3xK10 “ST. 
2mc 


2k 2k oo 2K ok 2K 


4. Freezing of He>: at low temperatures He* can be converted from liquid to solid by 
application of pressure. A peculiar feature of its phase boundary is that (dP/dT ) mening iS 
negative at temperatures below 0.3 K [(dP/dT ),, © —30atm K~! at T + 0.1K]. We will 
use a simple model of liquid and solid phases of He* to account for this feature. 


(a) In the solid phase, the He* atoms form a crystal lattice. Each atom has nuclear spin 
of 1/2. Ignoring the interaction between spins, what is the entropy per particle s,, due 
to the spin degrees of freedom? 

Entropy of solid He* comes from the nuclear spin degeneracies, and is given by 
S,  k,ln(2%) 


=F y= eln2. 


(b) Liquid He? is modeled as an ideal fermi gas, with a volume of 46 A} per atom. What 
is its fermi temperature 7,,, in degrees Kelvin? 


The fermi temperature for liquid He* may be obtained from its density as 


a ee 
Pky Imkg \8aV 


_ (67x10 3 wa 
™ 2. (6.8 x 10-27)(1.38 x 10-23) \ 84x 46x 10-0) 


(c) How does the heat capacity of liquid He* behave at low temperatures? Write down an 
expression for Cy in terms of N, T,k,,T;, up to a numerical constant, that is valid 
for T < T;. 

The heat capacity comes from the excited states at the fermi surface, and is given 
by 

3N We T 


= —Nk,—. 
t.. 4° oe, 


WT Tv , 
Cy = ky pkgT Dep) = GT 


(d) Using the result in (c), calculate the entropy per particle s,, in the liquid at low 
temperatures. For T < T;, which phase (solid or liquid) has the higher entropy? 


The entropy can be obtained from the heat capacity as 


kp 


_ Tds me ii 
~ = Nag a 
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As T — 0, s, > 0, while s, remains finite. This is an unusual situation in which 
the solid has more entropy than the liquid! (The finite entropy is due to treating the 
nuclear spins as independent. There is actually a weak coupling between spins, which 
causes magnetic ordering at a much lower temperature, removing the finite entropy.) 


(e) By equating chemical potentials, or by any other technique, prove the Clausius— 
Clapeyron equation (dP/dT ) meting = (Se — 5,)/(Ve — v,), Where v, and v, are the 
volumes per particle in the liquid and solid phases, respectively. 

The Clausius—Clapeyron equation can be obtained by equating the chemical poten- 
tials at the phase boundary, 
bw (T, P)=p,(T,P), and p,(T+AT,P+AP)=p,(T+AT, P+AP). 
Expanding the second equation, and using the thermodynamic identities 
0 0 
(¥) = S, and ($) =-V, 
OT) p OP) ¢ 
results in 
oP _ Se 5y 
oT melting 7 Up — Us 
(f) It is found experimentally that v, —v, = 3A? per atom. Using this information, plus 


the results obtained in previous parts, estimate (dP/dT ) meting at TK Tp. 
The negative slope of the phase boundary results from the solid having more entropy 


than the liquid, and can be calculated from the Clausius—Clapeyron relation 


we T 
(F) Sp — 5, = (£)-In2 
= ~ kp 5 
melting 


oT Up — Us Up — Us 


Using the values, T = 0.1K, Ty = 9.2K, and v, —v, =3 A}, we estimate 


oP 7 ji 
— x —2.7x 10° PaK™, 
oT melting 


in reasonable agreement with the observations. 


2k 2k 2k Kk KK 


5. Non-interacting fermions: consider a grand canonical ensemble of non-interacting fermions 
with chemical potential jz. The one-particle states are labeled by a wave vector k, and 
have energies E(k). 


(a) What is the joint probability P({nz}) of finding a set of occupation numbers {n;} of 
the one-particle states? 

In the grand canonical ensemble with chemical potential jx, the joint probability of 

finding a set of occupation numbers {n;} for one-particle states of energies E (k) is 


given by the fermi distribution 


xp [Ble EH) | 
ANN orn (2 


; where nz=Oorl, foreach k. 
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(b) 


(c) 


(d 


= 


(e 


Nae 


(f) 


Express your answer to part (a) in terms of the average occupation numbers {(ng)_}. 


The average occupation numbers are given by 


ie [puedo] 
"1 +exp[B(u—e)] 


from which we obtain 


_ _(m)- 
1— (nj) 


This enables us to write the joint probability as 


exp[A(u—€()| 


A random variable has a set of & discrete outcomes with probabilities p,, where 
n=1,2,---,&. What is the entropy of this probability distribution? What is the 
maximum possible entropy? 

A random variable has a set of € discrete outcomes with probabilities p,. The 
entropy of this probability distribution is calculated from 


a 


S= —kp YP, In p,- 


n=l 
The maximum entropy is obtained if all probabilities are equal, p,, = 1/£, and given 
by Siax = kg ln £. 
Calculate the entropy of the probability distribution for fermion occupation numbers 
in part (b), and comment on its zero-temperature limit. 
Since the occupation numbers of different one-particle states are independent, the 
corresponding entropies are additive, and given by 


Sky Do [(mg)_ In (ng)_ + (1 (rg)_) 19 (1 —(mq)_)] 


k 


In the zero-temperature limit all occupation numbers are either 0 or 1. In either case 
the contribution to entropy is zero, and the fermi system at T =0 has zero entropy. 
Calculate the variance of the total number of particles (N?)., and comment on its 
zero-temperature behavior. 

The total number of particles is given by N = )°;. nj. Since the occupation numbers 
are independent, 


(N*), = O(n) =O ((nz)_ (rg) ) = leg)_ (1 (mah), 


k k 


since (n2) — (nj) _. Again, since at T = 0, (nz)_ =0 or 1, the variance (N?). vanishes. 
The number fluctuations of a gas are related to its compressibility k;, and number 
density n = N/V, by 


(N?)_ = NnkgTkr. 
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Give a numerical estimate of the compressibility of the fermi gas in a metal at T=0 
in units of A3eV7!. 
. : oo 2) : 

To obtain the compressibility from (N ). = Nnk,Tk,, we need to examine the 
behavior at small but finite temperatures. At small but finite T, a small fraction of 
states around the fermi energy have occupation numbers around 1/2. The number of 
such states is roughly NkgT/e€,, and hence we can estimate the variance as 

1 NkgT 


(N?). = NnkgTky © ar 


The compressibility is then approximated as 


male 


oS > 
4ne, 


Kr 


where n= N/V is the density. For electrons in a typical metal n~ 10? m-3 ~ 0.1 A}, 


and &; © 5eV © 5x 104K, resulting in 
~05 Adevy-! 
Kp © 0.5 A°eV™. 
OR ACK KOK 


6. Stoner ferromagnetism: the conduction electrons in a metal can be treated as a gas of 
fermions of spin 1/2 (with up/down degeneracy), and density n = N/V. The Coulomb 
repulsion favors wave functions that are anti-symmetric in position coordinates, thus 
keeping the electrons apart. Because of the full (position and spin) anti-symmetry of 
fermionic wave functions, this interaction may be approximated by an effective spin-spin 
coupling that favors states with parallel spins. In this simple approximation, the net effect 


is described by an interaction energy 


where N, and N_ = N—N, are the numbers of electrons with up and down spins, and V 
is the volume. (The parameter a is related to the scattering length a by a = 47rh?a/m.) 


(a) The ground state has two fermi seas filled by the spin-up and spin-down electrons. 
Express the corresponding fermi wavevectors k,, in terms of the densities n, = N/V. 
In the ground state, all available wavevectors are filled up in a sphere. Using the 


appropriate density of states, the corresponding radii of ks are calculated as 


Bk 43 4 Vk3 
N=vf “Savf" 7 dk = = 
k<kpy (277) 0 (27) 677 


leading to 


kes = (67?n,)'” . 
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(b) Calculate the kinetic energy density of the ground state as a function of the densities 
n,, and fundamental constants. 


For each fermi sea, the kinetic energy is given by 


/ Rie Bk R24 ki, 
k 


Exins = V = ¥ 
ce <kp, 2m (27)° 2m (27) 5 


where m is the mass of the electron. The total kinetic energy density is thus equal to 


EG Rh 1 5 5 Rh 3 2 2/3 5/3 
ins een f ( 3 A) ; 
V~ Im Tom (K+ the) = 95 5 (Om) (me +m 


(c) Assuming small deviations n, = n/2+6 from the symmetric state, expand the kinetic 
energy to fourth order in 6. 


Using the expansion 
& 10 & 


3 40 _ 64 
~4/3 -7/3 (a5 
a 6 tet 2g TOM): 


(x4 8)93 = 53 4 22234 a 


the kinetic energy calculated in the previous part can be written as 


ams" [G) 45) tam) #40] 


(d) Express the spin-spin interaction density U/V in terms of n and 6. Find the critical 


value of @,, such that for a > a, the electron gas can lower its total energy by 
spontaneously developing a magnetization. (This is known as the Stoner instability.) 


The interaction energy density is 


Yann =a( +8) ($8) <0 ost 


The total energy density has the form 


E_ E,yt+an?/4 
ve V 


; E (x)? 2 8 -«| +0 (54), 


m 


When the second-order term in 6 is negative, the electron gas has lower energy for 


finite 5, that is, it acquires a spontaneous magnetization. This occurs for 


4 “ he 
a>a.=r (307) ”° —n?, 
3 2m 


(e 


wm 


Explain qualitatively, and sketch the behavior of, the spontaneous magnetization as a 
function of a. 

For a> @,, the optimal value of 6 is obtained by minimizing the energy density. 
Since the coefficient of the fourth-order term is positive, and the optimal 6 goes to zero 
continuously as a@ > a,, the minimum energy is obtained for a value of & «(a—a,). 


The magnetization is proportional to 6, and hence grows in the vicinity of a, as 
/a—«a., as sketched below. 
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A Mx 6 
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7. Boson magnetism: consider a gas of non-interacting spin | bosons, each subject to a 


Hamiltonian 


p? 
H,(p, 8,) = mm HSB, 


where (ty = eh/mc, and s, takes three possible values of (—1, 0, +1). (The orbital effect, 
p— p—eA, has been ignored.) 


a) Ina grand canonical ensemble of chemical potential jz, what are the average occupation 
g Pp be 8 Pp 
numbers {(n, (k)), (no (k)), (n_(h)y} of one-particle states of wavenumber k= p/h? 


Average occupation numbers of the one-particle states in the grand canonical 


ensemble of chemical potential jz are given by the Bose-Einstein distribution 


- 1 
k) = ———_—_ for s=—1,0, 1 
O= Saar ) 


1 
exp [A(¢ HosB) Bu| 1 


(b) Calculate the average total numbers {N,, Nj, N_} of bosons with the three possible 
values of s, in terms of the functions f*(z). 


The total numbers of particles with spin s are given by 
1 
exp E ( = HosB) Bu| 1 


= V 
N=D10, = =a [vk 
{k} 


After a change of variables, k = x'/? ,/2mk,T /h, we get 


V 
N= 35 Fin (cot), 


where 


m— 
ee dxx 


Lope 
m\%) = ry A i 
@) T(m) I zte*—1 /2amk ,T 
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(c) Write down the expression for the magnetization M(T, w) = b@y(N, — N_), and by 
expanding the result for small B find the zero-field susceptibility x(T, 4) = 0M/0B\,_o. 


The magnetization is obtained from 
M(T, 1) = bo (N,.— N_) 
4 = y 
= Ho Ys [fib (coPt?) — fia (ce PH0)]. 


Expanding the result for small B gives 


a 
Safo (ze*PH0?) & faba [1+ BoB] © fejo(z) +z: BoB afr: 


Using zdf,* (z)/dz = f_,(z), we obtain 


V + 265 4 Aa 
M= Mo 3 2BMoB): fijal2) Te “B: fin), 
and 
oM 22 V 
X= =-— ‘fin()- 


OB, keT MO 


To find the behavior of x(T,n), where n = N/V is the total density, proceed as 
follows. 

(d) For B = 0, find the high-temperature expansion for z(B, n) = e8", correct to second 
order in n. Hence obtain the first correction from quantum statistics to y(T, n) at high 
temperatures. 

In the high-temperature limit, z is small. Use the Taylor expansion for f,(z) to 


write the total density n(B = 0), as 


Ny +No+N_ 
V 


3 
n(B=0) = = 5 Sha) 


B=0 


3 oe 
~ i+ at 33a . 


Inverting the above equation gives 


The susceptibility is then calculated as 


2s V 


= Lp fin®: 
B 


2m 1 1 nas > 
= At [i+ / sat aa) ( - +O(n’*)}. 
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(e) Find the temperature T.(n, B = 0) of Bose-Einstein condensation. What happens to 
X(T, n) on approaching T,.(n) from the high-temperature side? 


Bose-Einstein condensation occurs when z = |, at a density 


3 


or a temperature 


ie \= 2 n 2/3 
WT Iamky \3h55) ” 


where £3, = fyj(1) © 2.61. Since lim,,, fij.(z) = 0, the susceptibility x(T, n) 
diverges on approaching T.(n) from the high-temperature side. 


(f 


Ye 


What is the chemical potential w for T< T,(n), at a small but finite value of B? 
Which one-particle state has a macroscopic occupation number? 
Since n,(k, B) = [e-ebE sa) — ‘| is a positive number for all k and s,, w is 


bounded above by the minimum possible energy, that is, 
for T<T,, and B finite, zePoB —], => Mb =—LoB. 


Hence the macroscopically occupied one-particle state has k =0, and s, = +1. 


(g) Using the result in (f), find the spontaneous magnetization, 
M(T,n) = lim M(T, n, B). 
Bo 


The contribution of the excited states to the magnetization vanishes as B — 0. 
Therefore the total magnetization for T < T.. is due to the macroscopic occupation of 
the (k=0, s, = +1) state, and 


M(T, n) = po Vin, (k = 0) 


3V 
= by V (n > Nexcited) =BHo (w- rls): 


2k 2k 2k Kk KK 


8. Dirac fermions are non-interacting particles of spin 1/2. The one-particle states come in 


pairs of positive and negative energies, 


E.() =4V Att PRC, 


independent of spin. 


(a) For any fermionic system of chemical potential , show that the probability of finding 
an occupied state of energy +6 is the same as that of finding an unoccupied state 
of energy w — 6. (6 is any constant energy.) 

According to fermi statistics, the probability of occupation of a state of energy E€ is 
epiuEmn 


€)| = ———~. fe =0, 1. 
pln)1= aero 
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For a state of energy 4+ 6, 


eBon eo 1 


p[n(ut+6)] = = pla(ut+6)=1)= 


1+ 3’ T+e 1+e-68" 
Similarly, for a state of energy w—6, 
e7 Pn 1 
PhO) pe = Pe OO ape ee 


that is, the probability of finding an occupied state of energy 4+ is the same as that 
of finding an unoccupied state of energy — 6. 

(b) At zero temperature all negative energy Dirac states are occupied and all positive 
energy ones are empty, that is, w(T = 0) = 0. Using the result in (a) find the chemical 
potential at finite temperature T. 

The above result implies that for 4 = 0, (n(E)) + (n(— €)) is unchanged for any 
temperature; any particle leaving an occupied negative energy state goes to the 
corresponding unoccupied positive energy state. Adding up all such energies, we 
conclude that the total particle number is unchanged if j stays at zero. Thus, the 
particle-hole symmetry enforces (T ) = 0. 

(c 


YS 


Show that the mean excitation energy of this system at finite temperature satisfies 
E(k) 
(B6.()+1 


Using the label +(—) for the positive (energy) states, the excitation energy is 


E(T) — E(0) =4V e3 coi 
exp 


calculated as 


E(T) — E(0) = Yo [(n,(k)) E(k) + (= (n_(k))) €(4)] 


ks, 
Ex(K) 
BE, ()) aa 


(d) Evaluate the integral in part (c) for massless Dirac particles (i.e., for m = 0). 
For m=0, €,(k) = fic|k|, and 


ge) E(k) = wf o on ( 
exp 


4mk?dk hick 
873 ePhck 4 | 


2V k,T\> p& 3 
ee a pee h dx— 
qr he 0 e+] 


_1r kpT 
— Vk,T : 
60 he. 
For the final expression, we have noted that the needed integral is 3\f; (1), and used 


the value of fy (1) = 77*/720. 
(e) Calculate the heat capacity, C\, of such massless Dirac particles. 


E(T)—E(0) =4V [ (set Bhck = x) 


The heat capacity can now be evaluated as 


JE uae kaT \? 
pA EN ie 7 


oT 


Cy = 
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(f) Describe the qualitative dependence of the heat capacity at low temperature if the 
particles are massive. 

When m £0, there is an energy gap between occupied and empty states, and we 

thus expect an exponentially activated energy, and hence heat capacity. For the low 


energy excitations, 


, Bk 
E,(k) & me? + +>, 
+(k) © m a 
and thus 


2V 4ar./ = 
E(T) — E(0) © << mc2e-Pm? “TV / dxx2e—* 
7 Jo 


48 V cteBme . 


~ te 


The corresponding heat capacity, to leading order thus behaves as 


C(T) « i (Bmc?)” eBme 


2K ok 2k ok KKK 
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Bayes’ theorem, 44 
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Benford’s law, 54, 232 
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black-body radiation, 168 
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Boltzmann equation, 66, 72 
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bose occupation number, 195 
Bose-Einstein condensation, 196, 206, 
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Brillouin zone, 163, 167 
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Carnot cycle, 30, 217, 222 

Carnot engine, 10, 11, 30 

Carnot’s theorem, | 1 
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central limit theorem, 46 
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Clausius—Clapeyron, 30, 197, 205, 312, 
220 


318 


closed systems, | 

cluster expansion, 131 

coexistence, 140, 197 

collision, 69 

collision terms, 65 

commutation relation, 171 

compressibility, 8, 139, 156, 197 

condensation, 141, 146, 153 

conditional PDF, 44 

connected clusters, 134 

conservation laws, 79, 83 

conserved quantities, 62, 76, 80 

contact line, 214 

continuous transition, 149 

convexity, 145 

Coulomb system, 90, 149, 151, 153, 
178, 243, 271, 281, 299 

critical exponents, 149 

critical point, 146, 147, 155 

cumulant expansion, 127 

cumulant generating function, 39 

cumulants, 39, 127, 134 

cumulative probability function, 36 

curtosis, 39 

cycle, 10 


Debye model, 165 

Debye screening, 66, 90, 150, 244, 273 
Debye temperature, 167 
Debye-Hiickel, 271, 149 

degeneracy, 189 

degenerate quantum limit, 195 

density matrix, 173, 177, 185, 295 
density of states, 167 

diagrammatic representation, 129, 132 
diathermic walls, | 

diatomic gas, 123, 159, 266 
Dieterici’s equation, 151, 279 

Dirac fermions, 207, 211, 318 


directed random walk, 53, 229 
disconnected clusters, 129 
discontinuous transition, 149 
dispersion relation, 167, 169 
displacement, 7 
displacements, 6 


efficiency, 9, 12, 13 
effusion, 97 

Einstein model, 165 
empirical temperature, 78 
energy gap, 105 
engine, 8, 10 

engine, Carnot, 10 
ensemble, 59, 173 
ensemble average, 173 
enthalpy, 16, 117 
entropy, 13, 14, 26 
entropy of mixing, 52 
entropy, Boltzmann, 79 


entropy, microcanonical, 100, 110 


entropy, Shannon, 52 


equation of state, 3, 30, 146, 219 


equations of motion, 58 
equilibrium, 1, 2, 174 
equipartition, 122, 265 
ergodic, 63 

estimation, 52 

exchange, 183 

excluded volume, 136, 138 
expansivity, 8 
expectation value, 37, 44 
exponential, 48 
extensive, 7, 20, 48, 108 
extensivity, 20, 129, 134 


fermi energy, 191 
fermi gas, degenerate, 191 
fermi occupation number, 191 


fermi sea, 191, 206, 314 
fermi temperature, 194 
fermion, 183, 187, 203, 205, 303, 312 
first law, 5, 6, 102 

Fock space, 175 

force, 7 

forces, 6 

fountain effect, 201 
Fourier equation, 87 
fractal, 123, 269 

free energy, Gibbs, 18 
free energy, Helmholtz, 17 
fugacity, 134 


Gaussian distribution, 40 

Gibbs canonical ensemble, 116 

Gibbs free energy, 18, 117 

Gibbs inequality, 145 

Gibbs paradox, 108, 182 

Gibbs partition function, 116, 152, 285 

Gibbs phase rule, 22 

Gibbs—Duhem relation, 20 

glass, 31, 223 

grand canonical ensemble, 119, 140, 175 

grand partition function, 119, 133, 
188, 305 

grand potential, 18, 120, 134 


H-theorem, 72 

Hamiltonian, 58 

hard core, 130, 131, 136, 138, 142 

hard rods, 154 

hard sphere, 71, 122, 263 

harmonic oscillator, 121, 164, 168, 177, 
258, 294 

heat, 6, 102 

heat capacity, 8, 25, 105, 113, 159, 
168, 194, 198, 205, 311 

heat flux, 82, 87 

helium, 199, 204, 209, 311 

Helmholtz free energy, 17, 112 

Hermitian, 174, 171 

Hilbert space, 171, 175, 182 

hurricane, 31, 223 


a 


66, 


hydrodynamic equations, 80 
hydrodynamics, first order, 85 
hydrodynamics, zeroth order, 83, 94 
hydrophilic, 215 

hydrophobic, 215 


ideal gas, 4, 7, 106, 115, 117, 120, 
204, 305 

ideal gas, free expansion, 7 

ideal gas, quantum, 182, 189, 204, 305 

identical particles, 109, 111, 182, 186 

information, 51, 54, 73, 76, 79, 233 

intensive, 7, 20, 48 

internal energy, 5 

irreversibility, 74 

irreversible, 15 

Ising, 118 

isobaric, 117 

isotherm, 3, 4, 140 

isothermal, 17 


joint characteristic function, 44 
joint cumulants, 44 

joint Gaussian distribution, 46 
joint moments, 44 

joint PDF, 43 


kinetic theory, 58 
kurtosis, 39 


Lagrange multipliers, 53 
Langmuir isotherm, 124 

Laplace distribution, 53, 226 
latent heat, 27, 31, 197, 200, 224 
lattice, 162 

law of corresponding states, 146 
Levy distribution, 47 

linked clusters, 132 

Liouville’s theorem, 60, 100, 174 
liquid, 142, 146 

local density, 80 

local equilibrium, 76, 80, 83 
local expectation value, 80 

local velocity, 81 

log-normal distribution, 232 
longitudinal, 166, 209 

Lorentz gas, 92, 250 


macrostate, 59, 173 
magnetization, 118 

Manning transition, 153 
Maxwell construction, 140 
Maxwell distribution, 53, 228 
Maxwell relations, 21 

mean, 39 

mean-field theory, 141 

mean free time, 67 
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mechano-caloric effect, 201 
microcanonical ensemble, 99, 174 
microstate, 58, 171 

mixed state, 59, 173 

mixing entropy, 108, 182 
moments, 38, 127, 134 


mutual information, 56 


negative temperature, 104 

Nernst, 26 

normal distribution, 40 

normal modes, 158, 163, 168, 176, 288 


occupation number, 165, 205, 312 
occupation numbers, 103, 184, 188 
one-dimensional gas, 152, 283 
one-particle density, 63 
one-particle irreducible, 130, 135 
open systems, | 

optimal selection, 54, 231 


parity, 183 

partition function, 112, 175, 186 

Pauli paramagnetism, 204, 307 

periodic boundary conditions, 167, 
168, 175 

permutation, 182 

perpetual motion machine, 9 

phase diagram, 146 

phase separation, 140-141 

phase space, 58, 111, 171, 175, 186 

phase space density, 59, 60, 173 

phase transition, 142, 144 

phonons, 167, 203, 209 

photons, 168 

Planck, 169 

Poisson bracket, 61, 172 

Poisson distribution, 42 

Poisson—Boltzmann equation, 90, 244 

polarization, 166, 168 

polyatomic molecules, 157 

polyelectrolyte, 153 

polymer, 123, 125, 153, 269 

pressure, 78, 138 

pressure tensor, 82, 87 

probability, 35 

probability density function, 37 

pure state, 59, 173 


quantum degenerate limit, 191 
quantum observable, |71 
quasi-static, 6 
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random matrix, 55 
random variable, 35, 36 
Rayleigh distribution, 53, 227 
refrigerator, 9 
reservoir, 111, 175 
response function, 25 
response functions, 8 
reversible, 10, 14 

ring diagrams, 149, 271 
rotational modes, 161 
rotons, 203 


saddle point integration, 49 

second law, 8, 74, 102 

second law, Clausius, 9 

second law, Kelvin, 9 

second virial coefficient, 136, 137, 151, 
187, 276 

Shannon, 52 

single collision time, 86 

skewness, 39 

solid angle, 106 

solid, heat capacity, 162 

solid, vibrations, 162 

Sommerfeld expansion, 191 

sound, 84, 203, 209 

sound speed, 166 

spin, 118, 124, 125, 179, 189 

stability, 22, 103, 139, 146 

standard deviation, 41 

state functions, | 


statistical mechanics, classical, 99 
statistical mechanics, quantum, 157 
Stefan—Boltzmann law, 293, 170 
Stirling’s approximation, 50 

Stoner ferromagnetism, 205, 314 
streaming terms, 65, 67 
superconductor, 32 

superfluid, 199 

surface tension, 7, 29, 155 
surfactant, 29, 123, 155, 215, 268 
susceptibility, 8, 119, 124, 195, 204, 307 


Tchebycheff inequality, 54, 230 
temperature, empirical, 2 
temperature, ideal gas, 4, 30, 217 
temperature, Kelvin, 4, 30, 217 
temperature, thermodynamic, 12 
thermal conductivity, 87, 93, 255 
thermal equilibrium, | 

thermal wavelength, 176, 187 
thermodynamic coordinates, | 
thermodynamic limit, 114, 144 
thermodynamics, | 

third law, 26, 31, 224 

time reversal, 61, 62, 70, 74 
torsional oscillator, 202 
translational symmetry, 163 
transverse, 166, 168, 209 

triple point, 5, 22 

two-particle density, 63, 68 
two-body interaction, 64 


ultraviolet catastrophe, 168 
unbiased estimate, 52 
unconditional PDF, 43 

uniform density approximation, 155 
uniform density assumption, 142 
uniform distribution, 53, 226 


universality, 149 


van der Waals equation, 136, 137, 142 

van der Waals interaction, 130, 136, 
137, 199 

variance, 39 

variational approximation, 144 

vibrational modes, 159 

virial coefficient, 131, 135 

virial coefficients, 151, 276 

virial expansion, 131, 135, 149, 271 

virial theorem, 179, 301 

viscosity, 87, 94 

Vlasov equation, 67, 89, 90, 241, 243 


wavelength, 166 

wavevector, 166, 168, 163 
wetting, 200 

Wick’s theorem, 46, 86, 93, 255 
Wigner, 55 

work, 5, 102 


Young’s equation, 214 


zeroth law, 2, 101 


